Jun 10 14:52:12.559499 ip-10-0-138-72 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 14:52:12.559513 ip-10-0-138-72 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 14:52:12.559520 ip-10-0-138-72 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 14:52:12.559658 ip-10-0-138-72 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 14:52:22.741441 ip-10-0-138-72 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 14:52:22.741459 ip-10-0-138-72 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e05d0d09b45e401ea25a271eb33f76c5 -- Jun 10 14:55:19.772367 ip-10-0-138-72 systemd[1]: Starting Kubernetes Kubelet... Jun 10 14:55:20.150083 ip-10-0-138-72 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:55:20.150083 ip-10-0-138-72 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 14:55:20.150083 ip-10-0-138-72 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:55:20.150083 ip-10-0-138-72 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 14:55:20.150083 ip-10-0-138-72 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:55:20.150759 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.150094 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 14:55:20.153891 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153873 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.153891 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153891 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153895 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153900 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153903 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153906 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153909 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153912 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153914 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153917 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153920 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153923 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153927 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153933 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153937 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153940 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153943 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153946 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153949 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153952 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.153960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153955 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153959 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153964 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153969 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153974 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153978 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153981 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153984 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153987 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153990 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153993 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153996 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.153998 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154001 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154004 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154007 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154010 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154013 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154016 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.154458 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154032 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154037 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154041 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154045 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154049 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154054 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154059 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154062 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154065 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154067 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154071 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154074 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154077 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154080 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154083 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154086 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154090 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154093 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154095 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154098 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.154966 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154103 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154105 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154108 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154111 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154113 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154117 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154120 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154123 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154126 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154129 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154131 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154134 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154137 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154140 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154142 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154145 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154148 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154150 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154153 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154160 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.155553 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154163 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154166 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154169 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154172 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154175 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154178 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154181 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154184 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154187 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154190 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154193 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154195 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154198 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154202 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154204 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154207 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154210 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154212 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154215 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154218 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.156087 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154988 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154995 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.154999 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155003 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155006 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155009 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155012 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155014 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155033 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155036 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155039 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155042 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155045 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155051 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155055 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155059 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155062 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155066 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155069 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155073 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.156599 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155076 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155079 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155082 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155085 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155088 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155091 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155094 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155097 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155099 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155103 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155106 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155109 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155111 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155114 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155117 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155119 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155122 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155125 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155128 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155131 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.157154 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155134 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155136 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155139 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155142 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155151 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155155 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155158 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155161 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155165 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155168 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155172 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155175 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155179 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155183 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155186 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155189 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155192 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155194 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155197 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.157665 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155200 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155203 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155206 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155208 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155211 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155214 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155217 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155220 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155223 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155225 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155230 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155235 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155238 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155241 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155244 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155246 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155249 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155252 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155264 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.158288 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155268 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155270 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155273 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155276 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155279 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155282 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155285 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155288 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155291 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155294 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155296 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155299 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155302 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155305 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155308 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155310 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155313 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155316 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155319 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155322 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.158796 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155788 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155808 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155813 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155817 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155821 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155825 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155829 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155832 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155835 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155841 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155845 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155848 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155851 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155854 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155857 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155860 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155863 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155866 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155869 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.159348 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155872 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155875 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155878 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155880 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155883 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155888 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155892 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155896 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155899 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155902 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155905 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155907 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155911 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155914 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155919 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155922 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155925 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155927 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155930 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155933 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.159859 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155936 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155939 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155944 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155947 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155951 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155968 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155972 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155977 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155980 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155983 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155986 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155989 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155992 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155995 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.155998 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156001 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156004 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156007 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156009 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.160394 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156012 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156015 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156018 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156021 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156024 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156027 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156029 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156036 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156039 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156042 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156045 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156048 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156051 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156054 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156057 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156060 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156062 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156065 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156068 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.160925 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156074 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156077 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156079 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156082 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156085 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156088 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156091 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156094 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156097 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156100 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156102 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156105 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156108 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156111 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156114 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156117 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156120 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156123 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156126 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.161467 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156132 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156137 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156227 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156239 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156248 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156253 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156258 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156261 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156266 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156270 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156274 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156277 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156281 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156285 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156288 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156291 2578 flags.go:64] FLAG: --cgroup-root="" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156294 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156297 2578 flags.go:64] FLAG: --client-ca-file="" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156300 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156304 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156308 2578 flags.go:64] FLAG: --cluster-domain="" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156311 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156315 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156318 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 14:55:20.161960 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156322 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156326 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156329 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156332 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156336 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156339 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156342 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156346 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156352 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156355 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156361 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156365 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156368 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156371 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156374 2578 flags.go:64] FLAG: --enable-server="true" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156378 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156384 2578 flags.go:64] FLAG: --event-burst="100" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156387 2578 flags.go:64] FLAG: --event-qps="50" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156390 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156395 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156398 2578 flags.go:64] FLAG: --eviction-hard="" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156405 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156409 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156412 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156416 2578 flags.go:64] FLAG: --eviction-soft="" Jun 10 14:55:20.162610 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156419 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156422 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156426 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156429 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156432 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156435 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156438 2578 flags.go:64] FLAG: --feature-gates="" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156442 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156446 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156449 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156453 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156456 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156459 2578 flags.go:64] FLAG: --help="false" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156462 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156466 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156475 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156479 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156483 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156487 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156491 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156494 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156497 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156500 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 14:55:20.163271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156504 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156507 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156510 2578 flags.go:64] FLAG: --kube-reserved="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156514 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156518 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156521 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156524 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156527 2578 flags.go:64] FLAG: --lock-file="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156530 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156534 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156537 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156543 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156546 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156549 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156553 2578 flags.go:64] FLAG: --logging-format="text" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156556 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156559 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156562 2578 flags.go:64] FLAG: --manifest-url="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156565 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156570 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156573 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156578 2578 flags.go:64] FLAG: --max-pods="110" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156581 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156584 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156589 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 14:55:20.163936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156593 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156596 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156599 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156603 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156612 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156616 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156619 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156623 2578 flags.go:64] FLAG: --pod-cidr="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156626 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156631 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156634 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156638 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156641 2578 flags.go:64] FLAG: --port="10250" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156644 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156647 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-084061bc8aedeec86" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156651 2578 flags.go:64] FLAG: --qos-reserved="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156654 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156657 2578 flags.go:64] FLAG: --register-node="true" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156660 2578 flags.go:64] FLAG: --register-with-taints="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156665 2578 flags.go:64] FLAG: --registry-burst="10" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156668 2578 flags.go:64] FLAG: --registry-qps="5" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156671 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156674 2578 flags.go:64] FLAG: --reserved-memory="" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156678 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156681 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 14:55:20.164971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156685 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156688 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156691 2578 flags.go:64] FLAG: --runonce="false" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156694 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156699 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156702 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156706 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156709 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156713 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156716 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156719 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156722 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156726 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156730 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156733 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156736 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156739 2578 flags.go:64] FLAG: --system-cgroups="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156742 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156749 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156752 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156755 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156759 2578 flags.go:64] FLAG: --tls-min-version="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156762 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156765 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156769 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 14:55:20.165679 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156772 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156775 2578 flags.go:64] FLAG: --v="2" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156779 2578 flags.go:64] FLAG: --version="false" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156784 2578 flags.go:64] FLAG: --vmodule="" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156788 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.156791 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156920 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156924 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156928 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156932 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156935 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156939 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156942 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156947 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156951 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156954 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156958 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156961 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156964 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156967 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156971 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.166341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156974 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156977 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156980 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156983 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156987 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156989 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156992 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156995 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.156998 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157000 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157003 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157006 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157009 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157012 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157014 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157017 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157020 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157037 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157040 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157043 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.166883 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157046 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157049 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157053 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157056 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157059 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157062 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157065 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157068 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157070 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157073 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157076 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157079 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157083 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157086 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157089 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157092 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157095 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157098 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157101 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.167426 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157104 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157107 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157110 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157112 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157115 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157118 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157121 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157124 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157126 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157129 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157132 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157135 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157138 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157140 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157143 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157148 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157151 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157154 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157158 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.167938 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157160 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157164 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157167 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157170 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157173 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157176 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157179 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157184 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157188 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157192 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157195 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157198 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157201 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157204 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157207 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157210 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157213 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157216 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157218 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157221 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.168487 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157224 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157226 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157230 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157234 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157239 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.157242 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.157813 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.165909 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.165928 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.165943 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.165949 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166009 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166016 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166038 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.168996 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166043 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166046 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166049 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166053 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166056 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166059 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166062 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166065 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166068 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166071 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166074 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166076 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166080 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166083 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166086 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166088 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166091 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166094 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166097 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166101 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.169452 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166104 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166107 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166110 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166113 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166116 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166119 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166122 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166125 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166128 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166131 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166134 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166137 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166140 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166143 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166146 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166149 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166151 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166155 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166158 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166161 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.169968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166164 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166167 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166170 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166174 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166177 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166180 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166183 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166186 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166188 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166191 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166194 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166197 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166200 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166203 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166206 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166209 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166211 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166214 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166217 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166220 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.170511 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166224 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166227 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166229 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166232 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166237 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166242 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166245 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166248 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166251 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166255 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166260 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166263 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166266 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166269 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166272 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166276 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166282 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166286 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.171056 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166290 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166293 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166296 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166299 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166302 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166305 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166308 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166311 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166315 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166318 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166320 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166323 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166327 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166330 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166333 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166336 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166339 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.171540 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166342 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.166347 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166481 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166485 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166489 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166492 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166495 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166499 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166502 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166505 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166508 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166511 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166514 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166517 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:55:20.171978 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166522 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166526 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166529 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166532 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166535 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166538 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166541 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166543 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166546 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166549 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166552 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166556 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166560 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166563 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166567 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166570 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166573 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166576 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166579 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:55:20.172378 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166582 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166585 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166587 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166590 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166593 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166595 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166598 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166601 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166604 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166607 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166610 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166612 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166615 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166618 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166621 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166624 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166627 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166629 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166632 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:55:20.172869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166635 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166638 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166642 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166645 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166649 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166651 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166654 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166659 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166662 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166665 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166668 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166671 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166674 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166676 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166679 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166682 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166685 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166690 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:55:20.173377 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166693 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166696 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166699 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166702 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166705 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166707 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166710 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166713 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166716 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166720 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166722 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166725 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166728 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166731 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166733 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166736 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166741 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166744 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166747 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166750 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:55:20.173869 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166754 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166757 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166760 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166763 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166766 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166768 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166772 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166774 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166777 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:20.166780 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.166786 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.166918 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.171186 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.172416 2578 server.go:1019] "Starting client certificate rotation" Jun 10 14:55:20.174546 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.172526 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 14:55:20.174935 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.172560 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 14:55:20.174935 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.174673 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 14:55:20.176002 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.175980 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 14:55:20.186884 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.186861 2578 log.go:25] "Validated CRI v1 runtime API" Jun 10 14:55:20.189438 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.189423 2578 log.go:25] "Validated CRI v1 image API" Jun 10 14:55:20.190336 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.190318 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 14:55:20.193666 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.193644 2578 fs.go:135] Filesystem UUIDs: map[05ee04b3-2901-413f-b196-499e97e8022d:/dev/nvme0n1p3 5d805d50-b0c2-480d-8d08-92cdcdc896bb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 14:55:20.193736 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.193665 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 14:55:20.201155 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.200996 2578 manager.go:216] Machine: {Timestamp:2026-06-10 14:55:20.198828358 +0000 UTC m=+0.316388076 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099956 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d61451d907e6e69d11cffaf438c1d SystemUUID:ec2d6145-1d90-7e6e-69d1-1cffaf438c1d BootID:e05d0d09-b45e-401e-a25a-271eb33f76c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:8c:e3:d0:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:8c:e3:d0:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:ed:37:dc:e9:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 14:55:20.201155 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.201148 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 14:55:20.201283 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.201243 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 14:55:20.204147 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.204123 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 14:55:20.204308 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.204161 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 14:55:20.204802 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.204789 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 14:55:20.204838 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.204805 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 14:55:20.204838 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.204813 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 14:55:20.205392 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.205381 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 14:55:20.206226 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.206213 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 14:55:20.206606 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.206587 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 14:55:20.209475 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209447 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 14:55:20.209684 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209671 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 14:55:20.209751 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209710 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 10 14:55:20.209751 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209726 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 14:55:20.209751 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209743 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 14:55:20.209891 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209760 2578 kubelet.go:398] "Adding apiserver pod source" Jun 10 14:55:20.209891 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.209782 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 14:55:20.210337 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.210318 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 14:55:20.210407 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.210349 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 14:55:20.212838 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.212814 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 14:55:20.214408 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.214392 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 14:55:20.214476 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.214425 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 14:55:20.215129 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215116 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 14:55:20.215129 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215133 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215141 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215147 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215156 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215162 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215170 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215176 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215183 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215189 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215198 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 14:55:20.215229 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.215203 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 14:55:20.216710 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.216698 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 14:55:20.216710 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.216708 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 14:55:20.220074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.220058 2578 server.go:1268] "Started kubelet" Jun 10 14:55:20.220196 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.220149 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 14:55:20.220252 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.220224 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 14:55:20.220405 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.220373 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 14:55:20.220911 ip-10-0-138-72 systemd[1]: Started Kubernetes Kubelet. Jun 10 14:55:20.221509 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.221434 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 14:55:20.221877 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.221778 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 14:55:20.221959 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.221780 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 14:55:20.222207 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.222170 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 14:55:20.222485 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.222469 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 10 14:55:20.225529 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.224690 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-72.ec2.internal.18b7c00875fb9b34 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-72.ec2.internal,UID:ip-10-0-138-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-72.ec2.internal,},FirstTimestamp:2026-06-10 14:55:20.220015412 +0000 UTC m=+0.337575129,LastTimestamp:2026-06-10 14:55:20.220015412 +0000 UTC m=+0.337575129,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-72.ec2.internal,}" Jun 10 14:55:20.226293 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.226276 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 14:55:20.226293 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.226287 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 14:55:20.226696 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.226675 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.227172 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.226997 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 14:55:20.227172 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227020 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 14:55:20.227172 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227130 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 14:55:20.227391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227281 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 14:55:20.227391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227330 2578 factory.go:55] Registering systemd factory Jun 10 14:55:20.227391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227341 2578 factory.go:223] Registration of the systemd container factory successfully Jun 10 14:55:20.227391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227371 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 10 14:55:20.227391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227379 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 10 14:55:20.227608 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.227434 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 14:55:20.227608 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227587 2578 factory.go:153] Registering CRI-O factory Jun 10 14:55:20.227608 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227607 2578 factory.go:223] Registration of the crio container factory successfully Jun 10 14:55:20.227743 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227632 2578 factory.go:103] Registering Raw factory Jun 10 14:55:20.227743 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.227646 2578 manager.go:1196] Started watching for new ooms in manager Jun 10 14:55:20.228136 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.228122 2578 manager.go:349] Starting recovery of all containers Jun 10 14:55:20.228809 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.228778 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 14:55:20.229014 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.228991 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 14:55:20.233996 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.233968 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-drrlr" Jun 10 14:55:20.239166 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.239148 2578 manager.go:354] Recovery completed Jun 10 14:55:20.242747 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.242726 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-drrlr" Jun 10 14:55:20.243384 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.243312 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.245655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.245639 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.245717 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.245672 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.245717 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.245682 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.246193 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246180 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 14:55:20.246193 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246192 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 14:55:20.246280 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246208 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 14:55:20.246280 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246232 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.246857 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246844 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.246903 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246867 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.246903 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.246876 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.247171 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.247160 2578 policy_none.go:49] "None policy: Start" Jun 10 14:55:20.247219 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.247175 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 14:55:20.247219 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.247185 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 14:55:20.247786 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.247725 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-72.ec2.internal.18b7c0087782cbdf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-72.ec2.internal,UID:ip-10-0-138-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-72.ec2.internal,},FirstTimestamp:2026-06-10 14:55:20.245652447 +0000 UTC m=+0.363212162,LastTimestamp:2026-06-10 14:55:20.245652447 +0000 UTC m=+0.363212162,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-72.ec2.internal,}" Jun 10 14:55:20.248063 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.248050 2578 policy_none.go:47] "Start" Jun 10 14:55:20.290241 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.290215 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.291511 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.291554 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.291574 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.291651 2578 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293386 2578 manager.go:337] "Starting Device Plugin manager" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.293422 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293438 2578 server.go:87] "Starting device plugin registration server" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293726 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293740 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293799 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.293924 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.294048 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.294060 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.294544 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 14:55:20.294914 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.294598 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.392198 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.392166 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal"] Jun 10 14:55:20.392271 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.392257 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.393484 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.393460 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.393609 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.393494 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.393609 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.393511 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.394245 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.394047 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.395097 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395081 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.395282 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395252 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.395282 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.395449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395289 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.395449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.395449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395324 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.395449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395327 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.395775 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395759 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.395847 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395786 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.395847 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395810 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.395847 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395823 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.395847 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395789 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.396059 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.395864 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.397065 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.397050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.397142 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.397078 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:55:20.397801 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.397781 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:55:20.397897 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.397827 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:55:20.397897 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.397843 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:55:20.404041 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.404023 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.404127 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.404048 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-72.ec2.internal\": node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.421874 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.421848 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.428692 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.428660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d052639297a2fde41914445a4e994b5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-72.ec2.internal\" (UID: \"4d052639297a2fde41914445a4e994b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.428789 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.428719 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-72.ec2.internal\" not found" node="ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.429141 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.429127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.429211 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.429158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.433378 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.433360 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-72.ec2.internal\" not found" node="ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.522908 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.522875 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.529880 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.530015 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.530015 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d052639297a2fde41914445a4e994b5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-72.ec2.internal\" (UID: \"4d052639297a2fde41914445a4e994b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.530015 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d052639297a2fde41914445a4e994b5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-72.ec2.internal\" (UID: \"4d052639297a2fde41914445a4e994b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.530015 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.530015 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.529974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd1f50fd16a8195bb3bfcb2e3680ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal\" (UID: \"0afd1f50fd16a8195bb3bfcb2e3680ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.623478 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.623445 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.724294 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.724215 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.732608 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.732582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.737803 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:20.737787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:20.824663 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.824624 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:20.925153 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:20.925123 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:21.025686 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:21.025600 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:21.126348 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:21.126203 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:21.171554 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.171521 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 14:55:21.172261 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.171705 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 14:55:21.226652 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:21.226615 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:21.228643 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:21.228618 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d052639297a2fde41914445a4e994b5.slice/crio-f4e230ac3d7ff7b0046af07c2719f1bce70dbf259e87feb18e38d8643cfdb807 WatchSource:0}: Error finding container f4e230ac3d7ff7b0046af07c2719f1bce70dbf259e87feb18e38d8643cfdb807: Status 404 returned error can't find the container with id f4e230ac3d7ff7b0046af07c2719f1bce70dbf259e87feb18e38d8643cfdb807 Jun 10 14:55:21.229072 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:21.229054 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afd1f50fd16a8195bb3bfcb2e3680ed.slice/crio-9d790276c09102f7109db5f2f11fddf698b8702d5172d352fb5b300fefd1fcb8 WatchSource:0}: Error finding container 9d790276c09102f7109db5f2f11fddf698b8702d5172d352fb5b300fefd1fcb8: Status 404 returned error can't find the container with id 9d790276c09102f7109db5f2f11fddf698b8702d5172d352fb5b300fefd1fcb8 Jun 10 14:55:21.234959 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.234923 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 14:55:21.244790 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.244751 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 14:50:20 +0000 UTC" deadline="2028-01-23 14:57:16.086054879 +0000 UTC" Jun 10 14:55:21.244790 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.244787 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14208h1m54.841270217s" Jun 10 14:55:21.275305 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.275276 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:21.295206 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.295078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" event={"ID":"4d052639297a2fde41914445a4e994b5","Type":"ContainerStarted","Data":"f4e230ac3d7ff7b0046af07c2719f1bce70dbf259e87feb18e38d8643cfdb807"} Jun 10 14:55:21.296053 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.296032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" event={"ID":"0afd1f50fd16a8195bb3bfcb2e3680ed","Type":"ContainerStarted","Data":"9d790276c09102f7109db5f2f11fddf698b8702d5172d352fb5b300fefd1fcb8"} Jun 10 14:55:21.327215 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:21.327189 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-72.ec2.internal\" not found" Jun 10 14:55:21.362095 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.362072 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:21.426997 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.426970 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" Jun 10 14:55:21.439804 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.439781 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 14:55:21.440852 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.440839 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" Jun 10 14:55:21.451711 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.451695 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 14:55:21.616730 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:21.616653 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:22.211061 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.211022 2578 apiserver.go:52] "Watching apiserver" Jun 10 14:55:22.217587 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.217558 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 14:55:22.219541 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.219515 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d","openshift-cluster-node-tuning-operator/tuned-nvndg","openshift-image-registry/node-ca-8d6r2","openshift-multus/multus-additional-cni-plugins-6tnqv","openshift-multus/multus-wfrmz","openshift-network-diagnostics/network-check-target-zns8h","kube-system/global-pull-secret-syncer-lddgs","kube-system/konnectivity-agent-fsfcj","openshift-dns/node-resolver-clpwq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal","openshift-multus/network-metrics-daemon-xcj2n","openshift-network-operator/iptables-alerter-ztxjk","openshift-ovn-kubernetes/ovnkube-node-4dhk4"] Jun 10 14:55:22.221351 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.221321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:22.221462 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.221405 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:22.222490 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.222469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.224004 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.223984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.224717 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.224668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.225294 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.225037 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.225294 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.225093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cggs2\"" Jun 10 14:55:22.225294 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.225150 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 14:55:22.225498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.225368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.226148 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.226127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n452z\"" Jun 10 14:55:22.226266 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.226130 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.226386 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.226372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.226560 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.226544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.227025 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.226647 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 14:55:22.227895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.227693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.227895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.227766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.227895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.227795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.228634 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.228614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 14:55:22.228926 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.228902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n2qpw\"" Jun 10 14:55:22.229578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.229200 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.229578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.229249 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.229817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230397 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230622 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdrt7\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230667 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k2d66\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230758 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 14:55:22.231074 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.230995 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 14:55:22.233008 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.232708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.233008 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.232836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 14:55:22.233008 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.232890 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-87nqr\"" Jun 10 14:55:22.233395 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.233377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 14:55:22.234266 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.234185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.234672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.234652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 14:55:22.235225 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235204 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.235323 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235208 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nsm8n\"" Jun 10 14:55:22.235501 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235483 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 14:55:22.235589 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.235646 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.235934 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.235915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 14:55:22.237033 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.237015 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.237120 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.237085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:22.237190 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.237172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 14:55:22.237780 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.237619 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.237780 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.237619 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.237780 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.237757 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72h4q\"" Jun 10 14:55:22.238259 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gdmkn\"" Jun 10 14:55:22.238259 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238098 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 14:55:22.238259 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 14:55:22.238445 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238402 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 14:55:22.238772 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.238842 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.238809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:22.238963 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s6d9\" (UniqueName: \"kubernetes.io/projected/ab7d936f-c0b7-4acc-be05-98b108083539-kube-api-access-2s6d9\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.239018 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysconfig\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239018 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.238995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-sys\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239115 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-lib-modules\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239115 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-host\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239115 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/346f4452-02c4-46f3-b06a-51dbf5c43d27-serviceca\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqxt\" (UniqueName: \"kubernetes.io/projected/1516bac2-5eca-4fa1-b443-ca9676a5dc97-kube-api-access-9rqxt\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csbg4\" (UniqueName: \"kubernetes.io/projected/c80103d3-ad92-442e-a6e9-74e86f297ae3-kube-api-access-csbg4\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-os-release\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-cni-binary-copy\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-socket-dir-parent\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-multus\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-hostroot\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-etc-kubernetes\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-modprobe-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-k8s-cni-cncf-io\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-netns\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-kubelet\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-multus-certs\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-iptables-alerter-script\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346f4452-02c4-46f3-b06a-51dbf5c43d27-host\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-conf-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-host-slash\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj4g7\" (UniqueName: \"kubernetes.io/projected/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-kube-api-access-hj4g7\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-systemd\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-run\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-tuned\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-tmp\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-daemon-config\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-os-release\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-system-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-cnibin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.239978 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.239965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-kubernetes\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jk8\" (UniqueName: \"kubernetes.io/projected/346f4452-02c4-46f3-b06a-51dbf5c43d27-kube-api-access-j7jk8\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240197 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-bin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-conf\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-var-lib-kubelet\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-system-cni-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.240578 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.240558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-cnibin\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.262647 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.262619 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftjwb" Jun 10 14:55:22.273162 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.273140 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftjwb" Jun 10 14:55:22.328705 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.328674 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 14:55:22.341236 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-cnibin\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s6d9\" (UniqueName: \"kubernetes.io/projected/ab7d936f-c0b7-4acc-be05-98b108083539-kube-api-access-2s6d9\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysconfig\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-sys\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-host\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-cnibin\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/346f4452-02c4-46f3-b06a-51dbf5c43d27-serviceca\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.341393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-script-lib\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysconfig\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-agent-certs\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-bin\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-kubelet-config\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-host\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.341756 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-os-release\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342202 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-multus\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342202 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-sys\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.342202 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.341965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-os-release\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342349 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:22.342349 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-multus\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342349 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovn-node-metrics-cert\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.342535 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-k8s-cni-cncf-io\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/346f4452-02c4-46f3-b06a-51dbf5c43d27-serviceca\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-netns\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-kubelet\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-iptables-alerter-script\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-k8s-cni-cncf-io\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.342889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e10899-9138-485b-9224-dd474ba6dc37-tmp-dir\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.342992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-kubelet\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-netns\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-conf-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-host-slash\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj4g7\" (UniqueName: \"kubernetes.io/projected/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-kube-api-access-hj4g7\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-systemd\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-konnectivity-ca\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-netns\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.343289 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-var-lib-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-daemon-config\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-system-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-kubernetes\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szfqk\" (UniqueName: \"kubernetes.io/projected/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-kube-api-access-szfqk\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-kubelet\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-config\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2w2\" (UniqueName: \"kubernetes.io/projected/e069f58a-7dd2-49b1-821a-623fc7d1344c-kube-api-access-lc2w2\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-bin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-conf\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-var-lib-kubelet\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-sys-fs\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.343672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-netd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-system-cni-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-lib-modules\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6strc\" (UniqueName: \"kubernetes.io/projected/4ff7555e-8f65-4362-a233-156d96c35cf3-kube-api-access-6strc\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqxt\" (UniqueName: \"kubernetes.io/projected/1516bac2-5eca-4fa1-b443-ca9676a5dc97-kube-api-access-9rqxt\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93e10899-9138-485b-9224-dd474ba6dc37-hosts-file\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csbg4\" (UniqueName: \"kubernetes.io/projected/c80103d3-ad92-442e-a6e9-74e86f297ae3-kube-api-access-csbg4\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.343995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-cni-binary-copy\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-socket-dir-parent\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-hostroot\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-modprobe-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-tmp\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-etc-kubernetes\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.344249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346f4452-02c4-46f3-b06a-51dbf5c43d27-host\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-registration-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-node-log\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-multus-certs\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-socket-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-systemd-units\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-log-socket\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-system-cni-dir\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346f4452-02c4-46f3-b06a-51dbf5c43d27-host\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-var-lib-kubelet\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.344930 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-run-multus-certs\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.344988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-etc-kubernetes\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-iptables-alerter-script\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-conf\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-cni-binary-copy\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-env-overrides\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345206 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-conf-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-socket-dir-parent\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-run\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.345279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.345549 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-tuned\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.345549 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jk8\" (UniqueName: \"kubernetes.io/projected/346f4452-02c4-46f3-b06a-51dbf5c43d27-kube-api-access-j7jk8\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.345549 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-lib-modules\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.345634 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-systemd\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.345634 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345586 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 14:55:22.345634 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vk7n\" (UniqueName: \"kubernetes.io/projected/93e10899-9138-485b-9224-dd474ba6dc37-kube-api-access-5vk7n\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.345634 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345623 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c80103d3-ad92-442e-a6e9-74e86f297ae3-multus-daemon-config\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-slash\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-etc-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-host-slash\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-dbus\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-os-release\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.345750 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-system-cni-dir\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345953 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-cnibin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.345953 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-hostroot\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.346084 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.345976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.346084 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-cnibin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.346168 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-kubernetes\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.346168 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-modprobe-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.346247 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-device-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.346247 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-ovn\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.346323 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-sysctl-d\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.346323 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.346323 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab7d936f-c0b7-4acc-be05-98b108083539-os-release\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.346437 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.346437 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c80103d3-ad92-442e-a6e9-74e86f297ae3-host-var-lib-cni-bin\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.346437 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1516bac2-5eca-4fa1-b443-ca9676a5dc97-run\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.346553 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.346553 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-systemd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.346553 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.346490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.347083 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.347040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab7d936f-c0b7-4acc-be05-98b108083539-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.349090 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.349069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-etc-tuned\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.349197 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.349113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1516bac2-5eca-4fa1-b443-ca9676a5dc97-tmp\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.352921 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.352899 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:22.353026 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.352925 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:22.353026 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.352939 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:22.353109 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.353061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:22.853036178 +0000 UTC m=+2.970595915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:22.354765 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.354738 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s6d9\" (UniqueName: \"kubernetes.io/projected/ab7d936f-c0b7-4acc-be05-98b108083539-kube-api-access-2s6d9\") pod \"multus-additional-cni-plugins-6tnqv\" (UID: \"ab7d936f-c0b7-4acc-be05-98b108083539\") " pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.361062 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.361036 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj4g7\" (UniqueName: \"kubernetes.io/projected/fceb64ee-9e22-4688-9d90-f868cc9a4d8d-kube-api-access-hj4g7\") pod \"iptables-alerter-ztxjk\" (UID: \"fceb64ee-9e22-4688-9d90-f868cc9a4d8d\") " pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.361311 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.361287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqxt\" (UniqueName: \"kubernetes.io/projected/1516bac2-5eca-4fa1-b443-ca9676a5dc97-kube-api-access-9rqxt\") pod \"tuned-nvndg\" (UID: \"1516bac2-5eca-4fa1-b443-ca9676a5dc97\") " pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.362415 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.362391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csbg4\" (UniqueName: \"kubernetes.io/projected/c80103d3-ad92-442e-a6e9-74e86f297ae3-kube-api-access-csbg4\") pod \"multus-wfrmz\" (UID: \"c80103d3-ad92-442e-a6e9-74e86f297ae3\") " pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.367552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.367529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jk8\" (UniqueName: \"kubernetes.io/projected/346f4452-02c4-46f3-b06a-51dbf5c43d27-kube-api-access-j7jk8\") pod \"node-ca-8d6r2\" (UID: \"346f4452-02c4-46f3-b06a-51dbf5c43d27\") " pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.436479 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.436450 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:22.447707 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-env-overrides\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vk7n\" (UniqueName: \"kubernetes.io/projected/93e10899-9138-485b-9224-dd474ba6dc37-kube-api-access-5vk7n\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-slash\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-etc-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-dbus\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-device-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.447878 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-ovn\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-systemd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.447984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-script-lib\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-agent-certs\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-bin\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-kubelet-config\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovn-node-metrics-cert\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e10899-9138-485b-9224-dd474ba6dc37-tmp-dir\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-konnectivity-ca\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-netns\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448237 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-var-lib-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szfqk\" (UniqueName: \"kubernetes.io/projected/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-kube-api-access-szfqk\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-env-overrides\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-systemd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-kubelet\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-config\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-kubelet\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-device-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.448439 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-ovn\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.448523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:22.948504828 +0000 UTC m=+3.066064532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.448530 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.448586 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:22.94856986 +0000 UTC m=+3.066129586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2w2\" (UniqueName: \"kubernetes.io/projected/e069f58a-7dd2-49b1-821a-623fc7d1344c-kube-api-access-lc2w2\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.448824 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-sys-fs\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-etc-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-netd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-slash\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6strc\" (UniqueName: \"kubernetes.io/projected/4ff7555e-8f65-4362-a233-156d96c35cf3-kube-api-access-6strc\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-dbus\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93e10899-9138-485b-9224-dd474ba6dc37-hosts-file\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-var-lib-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-registration-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-run-netns\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-node-log\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-socket-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93e10899-9138-485b-9224-dd474ba6dc37-hosts-file\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448980 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-script-lib\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.449643 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.448970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-systemd-units\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449036 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-node-log\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-netd\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-log-socket\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-systemd-units\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-run-openvswitch\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-konnectivity-ca\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449144 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-cni-bin\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-log-socket\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e069f58a-7dd2-49b1-821a-623fc7d1344c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-registration-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-sys-fs\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4ff7555e-8f65-4362-a233-156d96c35cf3-socket-dir\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449381 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6b43326-1581-499d-b039-fffb047c730a-kubelet-config\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovnkube-config\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.450452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.449531 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e10899-9138-485b-9224-dd474ba6dc37-tmp-dir\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.451195 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.450981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e45815a9-3033-40e0-87fd-ecd0bfdd91f2-agent-certs\") pod \"konnectivity-agent-fsfcj\" (UID: \"e45815a9-3033-40e0-87fd-ecd0bfdd91f2\") " pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.451566 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.451539 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e069f58a-7dd2-49b1-821a-623fc7d1344c-ovn-node-metrics-cert\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.458478 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.458459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6strc\" (UniqueName: \"kubernetes.io/projected/4ff7555e-8f65-4362-a233-156d96c35cf3-kube-api-access-6strc\") pod \"aws-ebs-csi-driver-node-lj82d\" (UID: \"4ff7555e-8f65-4362-a233-156d96c35cf3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.461227 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.461152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2w2\" (UniqueName: \"kubernetes.io/projected/e069f58a-7dd2-49b1-821a-623fc7d1344c-kube-api-access-lc2w2\") pod \"ovnkube-node-4dhk4\" (UID: \"e069f58a-7dd2-49b1-821a-623fc7d1344c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.461661 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.461635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szfqk\" (UniqueName: \"kubernetes.io/projected/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-kube-api-access-szfqk\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.462557 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.462533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vk7n\" (UniqueName: \"kubernetes.io/projected/93e10899-9138-485b-9224-dd474ba6dc37-kube-api-access-5vk7n\") pod \"node-resolver-clpwq\" (UID: \"93e10899-9138-485b-9224-dd474ba6dc37\") " pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.536555 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.536519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztxjk" Jun 10 14:55:22.545140 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.545119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvndg" Jun 10 14:55:22.552647 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.552626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8d6r2" Jun 10 14:55:22.558199 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.558180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" Jun 10 14:55:22.564714 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.564695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfrmz" Jun 10 14:55:22.571274 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.571251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:22.578043 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.578027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:22.583712 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.583688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" Jun 10 14:55:22.589272 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.589247 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-clpwq" Jun 10 14:55:22.853141 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.853064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:22.853311 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.853234 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:22.853311 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.853263 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:22.853311 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.853276 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:22.853459 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.853340 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:23.853319326 +0000 UTC m=+3.970879086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:22.953675 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.953640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:22.953675 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:22.953680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:22.953902 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.953797 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:22.953902 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.953861 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:23.953846488 +0000 UTC m=+4.071406192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:22.953902 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.953797 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:22.954069 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:22.953987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:23.953966023 +0000 UTC m=+4.071525726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:23.064968 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.064914 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7d936f_c0b7_4acc_be05_98b108083539.slice/crio-0256cd9af133eb5d8b5a103a250db27f240d5575cebe7c77973995f3b215d8d1 WatchSource:0}: Error finding container 0256cd9af133eb5d8b5a103a250db27f240d5575cebe7c77973995f3b215d8d1: Status 404 returned error can't find the container with id 0256cd9af133eb5d8b5a103a250db27f240d5575cebe7c77973995f3b215d8d1 Jun 10 14:55:23.066564 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.066539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346f4452_02c4_46f3_b06a_51dbf5c43d27.slice/crio-3f79f7fde434e75c0fb70acaa09104223fa25d622b09a5b8132e057e1739dbd4 WatchSource:0}: Error finding container 3f79f7fde434e75c0fb70acaa09104223fa25d622b09a5b8132e057e1739dbd4: Status 404 returned error can't find the container with id 3f79f7fde434e75c0fb70acaa09104223fa25d622b09a5b8132e057e1739dbd4 Jun 10 14:55:23.089297 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.089209 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80103d3_ad92_442e_a6e9_74e86f297ae3.slice/crio-25f51657242eabd13cf9076a4aebb00819501ad32b98ac062a65dcce74d40aa4 WatchSource:0}: Error finding container 25f51657242eabd13cf9076a4aebb00819501ad32b98ac062a65dcce74d40aa4: Status 404 returned error can't find the container with id 25f51657242eabd13cf9076a4aebb00819501ad32b98ac062a65dcce74d40aa4 Jun 10 14:55:23.092697 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.092673 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff7555e_8f65_4362_a233_156d96c35cf3.slice/crio-68698eddd2bb1064449243b68766115d6bc585e0c479e62400b0fa8cd2b2b6fd WatchSource:0}: Error finding container 68698eddd2bb1064449243b68766115d6bc585e0c479e62400b0fa8cd2b2b6fd: Status 404 returned error can't find the container with id 68698eddd2bb1064449243b68766115d6bc585e0c479e62400b0fa8cd2b2b6fd Jun 10 14:55:23.105999 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.104740 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1516bac2_5eca_4fa1_b443_ca9676a5dc97.slice/crio-d852b3efc5d39a6119af241d6bc5898b48454a938644462b402f525a854f5504 WatchSource:0}: Error finding container d852b3efc5d39a6119af241d6bc5898b48454a938644462b402f525a854f5504: Status 404 returned error can't find the container with id d852b3efc5d39a6119af241d6bc5898b48454a938644462b402f525a854f5504 Jun 10 14:55:23.105999 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.105184 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode069f58a_7dd2_49b1_821a_623fc7d1344c.slice/crio-ab21b9a184ca68005f8379122038d9f3a88617b820dcd7064977790b5f934d14 WatchSource:0}: Error finding container ab21b9a184ca68005f8379122038d9f3a88617b820dcd7064977790b5f934d14: Status 404 returned error can't find the container with id ab21b9a184ca68005f8379122038d9f3a88617b820dcd7064977790b5f934d14 Jun 10 14:55:23.108038 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:23.108013 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e10899_9138_485b_9224_dd474ba6dc37.slice/crio-80504e0d9ad246d77654c744d0dde0ce903e95a63c26c7a141deb5191ae878cc WatchSource:0}: Error finding container 80504e0d9ad246d77654c744d0dde0ce903e95a63c26c7a141deb5191ae878cc: Status 404 returned error can't find the container with id 80504e0d9ad246d77654c744d0dde0ce903e95a63c26c7a141deb5191ae878cc Jun 10 14:55:23.275373 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.275303 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:50:22 +0000 UTC" deadline="2027-12-01 08:09:30.523063537 +0000 UTC" Jun 10 14:55:23.275373 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.275366 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12929h14m7.247700018s" Jun 10 14:55:23.302966 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.302915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-clpwq" event={"ID":"93e10899-9138-485b-9224-dd474ba6dc37","Type":"ContainerStarted","Data":"80504e0d9ad246d77654c744d0dde0ce903e95a63c26c7a141deb5191ae878cc"} Jun 10 14:55:23.304235 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.304208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"ab21b9a184ca68005f8379122038d9f3a88617b820dcd7064977790b5f934d14"} Jun 10 14:55:23.305467 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.305428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvndg" event={"ID":"1516bac2-5eca-4fa1-b443-ca9676a5dc97","Type":"ContainerStarted","Data":"d852b3efc5d39a6119af241d6bc5898b48454a938644462b402f525a854f5504"} Jun 10 14:55:23.306596 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.306572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztxjk" event={"ID":"fceb64ee-9e22-4688-9d90-f868cc9a4d8d","Type":"ContainerStarted","Data":"5e8420d924d8d3b2f56bc7f64d64ac32ff4ac6382de1a8c3c1192473cd737c52"} Jun 10 14:55:23.307723 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.307701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8d6r2" event={"ID":"346f4452-02c4-46f3-b06a-51dbf5c43d27","Type":"ContainerStarted","Data":"3f79f7fde434e75c0fb70acaa09104223fa25d622b09a5b8132e057e1739dbd4"} Jun 10 14:55:23.308810 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.308785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerStarted","Data":"0256cd9af133eb5d8b5a103a250db27f240d5575cebe7c77973995f3b215d8d1"} Jun 10 14:55:23.310802 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.310779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" event={"ID":"4d052639297a2fde41914445a4e994b5","Type":"ContainerStarted","Data":"4a65df61a6471f4fd8070003131c4a79293c9e363de1517c9236c7283c283eb8"} Jun 10 14:55:23.312056 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.312035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsfcj" event={"ID":"e45815a9-3033-40e0-87fd-ecd0bfdd91f2","Type":"ContainerStarted","Data":"e0e850fb9c568d66e918b5e2691113808e39031187d5d5cd974f6d03bb511bc2"} Jun 10 14:55:23.313299 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.313274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" event={"ID":"4ff7555e-8f65-4362-a233-156d96c35cf3","Type":"ContainerStarted","Data":"68698eddd2bb1064449243b68766115d6bc585e0c479e62400b0fa8cd2b2b6fd"} Jun 10 14:55:23.314375 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.314352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfrmz" event={"ID":"c80103d3-ad92-442e-a6e9-74e86f297ae3","Type":"ContainerStarted","Data":"25f51657242eabd13cf9076a4aebb00819501ad32b98ac062a65dcce74d40aa4"} Jun 10 14:55:23.325013 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.324965 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-72.ec2.internal" podStartSLOduration=2.324934793 podStartE2EDuration="2.324934793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:23.324771535 +0000 UTC m=+3.442331260" watchObservedRunningTime="2026-06-10 14:55:23.324934793 +0000 UTC m=+3.442494518" Jun 10 14:55:23.861936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.861900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:23.862196 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.862178 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:23.862279 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.862206 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:23.862279 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.862221 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:23.862384 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.862284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:25.862264992 +0000 UTC m=+5.979824712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:23.962991 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.962939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:23.963179 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:23.963011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:23.963238 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.963187 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:23.963288 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.963253 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:25.963233711 +0000 UTC m=+6.080793437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:23.963288 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.963257 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:23.963393 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:23.963295 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:25.963285014 +0000 UTC m=+6.080844720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:24.276961 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.275990 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:50:22 +0000 UTC" deadline="2027-11-18 05:53:03.357163914 +0000 UTC" Jun 10 14:55:24.276961 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.276033 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12614h57m39.081135899s" Jun 10 14:55:24.292447 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.292412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:24.292611 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:24.292542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:24.295429 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.295403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:24.295567 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:24.295515 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:24.295567 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.295548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:24.295747 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:24.295628 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:24.332455 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.332418 2578 generic.go:356] "Generic (PLEG): container finished" podID="0afd1f50fd16a8195bb3bfcb2e3680ed" containerID="d0c43b6c562fb9f9fdcb1130d8918b7c8cd272308809729343056969b3a7b1e3" exitCode=0 Jun 10 14:55:24.333328 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:24.333307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" event={"ID":"0afd1f50fd16a8195bb3bfcb2e3680ed","Type":"ContainerDied","Data":"d0c43b6c562fb9f9fdcb1130d8918b7c8cd272308809729343056969b3a7b1e3"} Jun 10 14:55:25.378713 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:25.378296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" event={"ID":"0afd1f50fd16a8195bb3bfcb2e3680ed","Type":"ContainerStarted","Data":"aec635ad1bc8df91c98db5326bf99cf2658e182e00e78f66cd3d7473c86ab848"} Jun 10 14:55:25.881653 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:25.881613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:25.881836 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.881808 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:25.881836 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.881827 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:25.881964 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.881841 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:25.881964 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.881900 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:29.881883073 +0000 UTC m=+9.999442777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:25.982087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:25.982142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.982308 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.982367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:29.982349149 +0000 UTC m=+10.099908854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.982741 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:25.982842 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:25.982788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:29.982772489 +0000 UTC m=+10.100332194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:26.292245 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:26.292156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:26.292402 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:26.292306 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:26.292735 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:26.292708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:26.292880 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:26.292816 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:26.292990 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:26.292974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:26.293081 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:26.293058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:28.292836 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:28.292802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:28.293242 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:28.292815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:28.293242 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:28.293006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:28.293242 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:28.293019 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:28.293242 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:28.293124 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:28.293242 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:28.293230 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:29.913221 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:29.913179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:29.913690 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:29.913365 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:29.913690 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:29.913391 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:29.913690 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:29.913406 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:29.913690 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:29.913471 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:37.913450121 +0000 UTC m=+18.031009836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:30.013627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:30.013674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.013791 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.013853 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:38.013833909 +0000 UTC m=+18.131393615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.014250 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:30.014335 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.014301 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:38.014284421 +0000 UTC m=+18.131844126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:30.296301 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:30.296228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:30.296301 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:30.296261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:30.296509 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:30.296228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:30.296509 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.296349 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:30.296509 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.296431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:30.296509 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:30.296498 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:32.292474 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:32.292436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:32.292910 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:32.292592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:32.292910 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:32.292607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:32.292910 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:32.292705 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:32.292910 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:32.292730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:32.292910 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:32.292794 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:34.295739 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:34.295684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:34.295739 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:34.295714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:34.295739 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:34.295714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:34.296290 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:34.295808 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:34.296290 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:34.295940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:34.296290 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:34.296052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:36.292439 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:36.292397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:36.292439 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:36.292415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:36.292895 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:36.292517 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:36.292895 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:36.292579 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:36.292895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:36.292611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:36.292895 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:36.292716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:37.973635 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:37.973587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:37.974256 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:37.973790 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:37.974256 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:37.973819 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:37.974256 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:37.973834 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:37.974256 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:37.973901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:55:53.973881341 +0000 UTC m=+34.091441061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:38.074659 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:38.074617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:38.074839 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:38.074666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:38.074839 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.074809 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:38.074839 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.074810 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:38.075024 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.074881 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:55:54.074862715 +0000 UTC m=+34.192422424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:38.075024 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.074901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:54.074891992 +0000 UTC m=+34.192451699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:38.292137 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:38.292053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:38.292291 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:38.292053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:38.292291 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.292194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:38.292291 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:38.292054 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:38.292291 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.292279 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:38.292484 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:38.292389 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:40.292882 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:40.292848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:40.293375 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:40.292977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:40.293375 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:40.293020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:40.293375 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:40.293175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:40.293375 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:40.293230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:40.293375 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:40.293314 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:42.292304 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.292065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:42.292900 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.292110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:42.292900 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:42.292436 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:42.292900 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:42.292480 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:42.292900 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.292117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:42.292900 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:42.292577 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:42.413431 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.413404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsfcj" event={"ID":"e45815a9-3033-40e0-87fd-ecd0bfdd91f2","Type":"ContainerStarted","Data":"e8027bddb7dccff1844eaecc025fe47b49683d4e3a8cd2b5a8ed2038ea6b856a"} Jun 10 14:55:42.414821 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.414794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" event={"ID":"4ff7555e-8f65-4362-a233-156d96c35cf3","Type":"ContainerStarted","Data":"c0056791fd7df92ea90f1b5ecfae09d41383a5d783534994834b478dce28a229"} Jun 10 14:55:42.416056 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.416031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfrmz" event={"ID":"c80103d3-ad92-442e-a6e9-74e86f297ae3","Type":"ContainerStarted","Data":"c9c535844c7f8987210a88ac7bd397879c97fd3e6cad1f86c6d5aa4e9857f2f4"} Jun 10 14:55:42.417209 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.417181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-clpwq" event={"ID":"93e10899-9138-485b-9224-dd474ba6dc37","Type":"ContainerStarted","Data":"2f2026aa598c5aacab7608f75b67a4097e72fb69024e8c55a98ad481a8095a50"} Jun 10 14:55:42.419817 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.419796 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 14:55:42.420151 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420129 2578 generic.go:356] "Generic (PLEG): container finished" podID="e069f58a-7dd2-49b1-821a-623fc7d1344c" containerID="7fddfabf2d092952afce4c9054e341ff51a8fc77e76d0da63dfa6cf2a2b1a40b" exitCode=1 Jun 10 14:55:42.420225 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"c6672bfe8b629e43cfac8814a34817a1b97bb1d181975c5893b0dd11a8aaed99"} Jun 10 14:55:42.420276 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"c17ae1cf3cdc38bc2ae22ae775b94355eff1974cbcd19f41ea29420b8d9f22d6"} Jun 10 14:55:42.420327 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"9280610ccf36a0d932cb5731a6667506e624a3803107810b80e57fe18df638a3"} Jun 10 14:55:42.420359 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"acf63e500d3f2fa6aa34a7206dac8f033e79f246207719dd15c367ea9fd754e2"} Jun 10 14:55:42.420393 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerDied","Data":"7fddfabf2d092952afce4c9054e341ff51a8fc77e76d0da63dfa6cf2a2b1a40b"} Jun 10 14:55:42.420437 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.420423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"a23ddc6488447b511ab3e7945052944cc3d3906d5c5c1ea11ed8fc56aaaf8ebd"} Jun 10 14:55:42.421575 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.421555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvndg" event={"ID":"1516bac2-5eca-4fa1-b443-ca9676a5dc97","Type":"ContainerStarted","Data":"0c814be5cc595baff14a475aef0f12e3df200b6447bdd22db89ec8d12d88759a"} Jun 10 14:55:42.423558 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.423535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8d6r2" event={"ID":"346f4452-02c4-46f3-b06a-51dbf5c43d27","Type":"ContainerStarted","Data":"c3cb1ca48d869a367e4cb67c169d4b84cac4a08863fca4e718a08a4f67273500"} Jun 10 14:55:42.425083 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.425055 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="f851c075d9ed97ae51f98c621b2756a229132c4e366d80f98348660c635bcd45" exitCode=0 Jun 10 14:55:42.425180 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.425101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"f851c075d9ed97ae51f98c621b2756a229132c4e366d80f98348660c635bcd45"} Jun 10 14:55:42.434934 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.434897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-72.ec2.internal" podStartSLOduration=21.434885755 podStartE2EDuration="21.434885755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:25.396116344 +0000 UTC m=+5.513676071" watchObservedRunningTime="2026-06-10 14:55:42.434885755 +0000 UTC m=+22.552445479" Jun 10 14:55:42.458704 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.458658 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nvndg" podStartSLOduration=4.01809991 podStartE2EDuration="22.458642476s" totalImagesPullingTime="18.440542566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:42.458269262 +0000 UTC m=+22.575828987" watchObservedRunningTime="2026-06-10 14:55:42.458642476 +0000 UTC m=+22.576202239" Jun 10 14:55:42.459038 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.458985 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fsfcj" podStartSLOduration=8.610065785 podStartE2EDuration="22.458977995s" totalImagesPullingTime="13.84891221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:42.435208711 +0000 UTC m=+22.552768434" watchObservedRunningTime="2026-06-10 14:55:42.458977995 +0000 UTC m=+22.576537722" Jun 10 14:55:42.508855 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.508801 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8d6r2" podStartSLOduration=4.048887398 podStartE2EDuration="22.508785041s" totalImagesPullingTime="18.459897643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:42.477676746 +0000 UTC m=+22.595236472" watchObservedRunningTime="2026-06-10 14:55:42.508785041 +0000 UTC m=+22.626344765" Jun 10 14:55:42.532682 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.532629 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wfrmz" podStartSLOduration=4.035187268 podStartE2EDuration="22.532613237s" totalImagesPullingTime="18.497425969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:42.532231469 +0000 UTC m=+22.649791194" watchObservedRunningTime="2026-06-10 14:55:42.532613237 +0000 UTC m=+22.650172987" Jun 10 14:55:42.871164 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:42.871133 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 14:55:43.307904 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.307774 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T14:55:42.871157246Z","UUID":"23e2a35a-5a30-4f29-b31b-b703b0803ad9","Handler":null,"Name":"","Endpoint":""} Jun 10 14:55:43.309717 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.309694 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 14:55:43.309848 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.309744 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 14:55:43.429053 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.429010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztxjk" event={"ID":"fceb64ee-9e22-4688-9d90-f868cc9a4d8d","Type":"ContainerStarted","Data":"ba16345055d69516c4ee67dd433d5aa8716308637195081f0e4312075c0960a9"} Jun 10 14:55:43.431240 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.431140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" event={"ID":"4ff7555e-8f65-4362-a233-156d96c35cf3","Type":"ContainerStarted","Data":"d010bc99d666cf23d09069cc20db13d04047cc5e27d4aad611e823264e2c94a1"} Jun 10 14:55:43.446367 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.446312 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-clpwq" podStartSLOduration=5.030723638 podStartE2EDuration="23.446290713s" totalImagesPullingTime="18.415567075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:42.548583996 +0000 UTC m=+22.666143720" watchObservedRunningTime="2026-06-10 14:55:43.446290713 +0000 UTC m=+23.563850438" Jun 10 14:55:43.446538 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.446505 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ztxjk" podStartSLOduration=5.339686582 podStartE2EDuration="23.446497045s" totalImagesPullingTime="18.106810463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:43.446098832 +0000 UTC m=+23.563658556" watchObservedRunningTime="2026-06-10 14:55:43.446497045 +0000 UTC m=+23.564056773" Jun 10 14:55:43.748925 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.748839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:43.749473 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:43.749453 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:44.292136 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.292049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:44.292302 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.292050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:44.292302 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.292189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:44.292302 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:44.292184 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:44.292302 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:44.292282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:44.292494 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:44.292342 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:44.436279 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.436236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" event={"ID":"4ff7555e-8f65-4362-a233-156d96c35cf3","Type":"ContainerStarted","Data":"22f58c7e85309c18cdb34a2f97dd45ff4b663eaed6ac8f1abda52241a920e8cc"} Jun 10 14:55:44.436906 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.436405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:44.437023 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.437007 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fsfcj" Jun 10 14:55:44.458667 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:44.458623 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lj82d" podStartSLOduration=4.088046469 podStartE2EDuration="24.458604294s" totalImagesPullingTime="20.370557825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:44.457786059 +0000 UTC m=+24.575345768" watchObservedRunningTime="2026-06-10 14:55:44.458604294 +0000 UTC m=+24.576164036" Jun 10 14:55:45.443303 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:45.443263 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 14:55:45.444562 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:45.444339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"097b740cf4b4968746966b6c2e4b380a5c4cb9fc1c865c2f10ec69f0467ce133"} Jun 10 14:55:46.292054 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:46.292022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:46.292228 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:46.292031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:46.292228 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:46.292114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:46.292228 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:46.292207 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:46.292391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:46.292266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:46.292391 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:46.292340 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:46.448654 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:46.448624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerStarted","Data":"080ca819c4693ab06c6bf845241f7971282b4acddde987771e627818abb3d301"} Jun 10 14:55:47.453751 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.453589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 14:55:47.454217 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.454151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"fd3aafa3a16cebf10162d7abadb75fa3fe5e3e31921b8cea156880fdd1cab5e2"} Jun 10 14:55:47.454565 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.454540 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:47.454688 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.454574 2578 scope.go:117] "RemoveContainer" containerID="7fddfabf2d092952afce4c9054e341ff51a8fc77e76d0da63dfa6cf2a2b1a40b" Jun 10 14:55:47.455990 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.455968 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="080ca819c4693ab06c6bf845241f7971282b4acddde987771e627818abb3d301" exitCode=0 Jun 10 14:55:47.456092 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.456010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"080ca819c4693ab06c6bf845241f7971282b4acddde987771e627818abb3d301"} Jun 10 14:55:47.470989 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:47.470968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:48.292327 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.292171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:48.292475 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.292171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:48.292475 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.292409 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:48.292475 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.292171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:48.292619 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.292493 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:48.292666 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.292619 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:48.460539 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.460503 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="0bc4da02589e4d492d2045b6aa79fa046ca32baf6c9abc9cc8fe22537c8f1a5c" exitCode=0 Jun 10 14:55:48.460974 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.460553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"0bc4da02589e4d492d2045b6aa79fa046ca32baf6c9abc9cc8fe22537c8f1a5c"} Jun 10 14:55:48.464515 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.464501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 14:55:48.464848 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.464829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" event={"ID":"e069f58a-7dd2-49b1-821a-623fc7d1344c","Type":"ContainerStarted","Data":"c27066eb762b3bc5a01e713d46c31f2c1de572690982257d309a9edae9fdf8e4"} Jun 10 14:55:48.464928 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.464917 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 14:55:48.465152 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.465135 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:48.479499 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.479480 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:48.517135 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.517088 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" podStartSLOduration=9.993048667 podStartE2EDuration="28.517073689s" totalImagesPullingTime="18.524025022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:48.516550444 +0000 UTC m=+28.634110192" watchObservedRunningTime="2026-06-10 14:55:48.517073689 +0000 UTC m=+28.634633449" Jun 10 14:55:48.810744 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.810661 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lddgs"] Jun 10 14:55:48.810922 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.810757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:48.810922 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.810859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:48.814851 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.814814 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zns8h"] Jun 10 14:55:48.815019 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.814922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:48.815077 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.815052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:48.815605 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.815579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcj2n"] Jun 10 14:55:48.815764 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:48.815669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:48.815845 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:48.815759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:49.472438 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:49.469494 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="ed8bc5bccc796268fec215ab06daeeefb7ac568eb38e4b77a703d4f5bffd3e05" exitCode=0 Jun 10 14:55:49.472438 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:49.470069 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 14:55:49.472438 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:49.470255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"ed8bc5bccc796268fec215ab06daeeefb7ac568eb38e4b77a703d4f5bffd3e05"} Jun 10 14:55:50.293608 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:50.293575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:50.293803 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:50.293675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:50.293803 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:50.293683 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:50.293803 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:50.293760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:50.293933 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:50.293829 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:50.293933 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:50.293861 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:50.471694 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:50.471665 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 14:55:51.698614 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:51.698579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:55:51.699322 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:51.698818 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 14:55:51.710766 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:51.710715 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" podUID="e069f58a-7dd2-49b1-821a-623fc7d1344c" containerName="ovnkube-controller" probeResult="failure" output="" Jun 10 14:55:51.720917 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:51.720867 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" podUID="e069f58a-7dd2-49b1-821a-623fc7d1344c" containerName="ovnkube-controller" probeResult="failure" output="" Jun 10 14:55:52.292976 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:52.292709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:52.293153 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:52.292721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:52.293153 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:52.293086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:52.293153 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:52.292726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:52.293316 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:52.293176 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:52.293316 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:52.293228 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:53.997916 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:53.997888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:53.998349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:53.998027 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:53.998349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:53.998042 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:53.998349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:53.998051 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2d5jh for pod openshift-network-diagnostics/network-check-target-zns8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:53.998349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:53.998097 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh podName:ba77a1da-2b7c-4077-b451-5cdc93df915d nodeName:}" failed. No retries permitted until 2026-06-10 14:56:25.99808418 +0000 UTC m=+66.115643882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2d5jh" (UniqueName: "kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh") pod "network-check-target-zns8h" (UID: "ba77a1da-2b7c-4077-b451-5cdc93df915d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:54.098252 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.098213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:54.098414 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.098268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:54.098414 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.098356 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:54.098497 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.098417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:56:26.098402063 +0000 UTC m=+66.215961769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:54.098497 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.098355 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:54.098586 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.098498 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret podName:b6b43326-1581-499d-b039-fffb047c730a nodeName:}" failed. No retries permitted until 2026-06-10 14:56:26.098485229 +0000 UTC m=+66.216044935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret") pod "global-pull-secret-syncer-lddgs" (UID: "b6b43326-1581-499d-b039-fffb047c730a") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:54.292368 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.292293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:54.292368 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.292331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:54.292532 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.292304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:54.292532 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.292395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lddgs" podUID="b6b43326-1581-499d-b039-fffb047c730a" Jun 10 14:55:54.292532 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.292485 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:55:54.292627 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:54.292550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zns8h" podUID="ba77a1da-2b7c-4077-b451-5cdc93df915d" Jun 10 14:55:54.483570 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.483538 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="876cd3a301c661cd39115a67e30abe64e564cfecf7542512e7869175c3c0dfd0" exitCode=0 Jun 10 14:55:54.483709 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.483583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"876cd3a301c661cd39115a67e30abe64e564cfecf7542512e7869175c3c0dfd0"} Jun 10 14:55:54.701386 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.701360 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-72.ec2.internal" event="NodeReady" Jun 10 14:55:54.701582 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.701522 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 14:55:54.751651 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.751621 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9ffw9"] Jun 10 14:55:54.766291 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.766265 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r6m96"] Jun 10 14:55:54.766408 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.766379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:54.768657 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.768630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 14:55:54.768788 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.768640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lpmmf\"" Jun 10 14:55:54.769298 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.769240 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 14:55:54.777432 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.777409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ffw9"] Jun 10 14:55:54.777544 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.777530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:54.778023 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.778002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6m96"] Jun 10 14:55:54.779977 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.779940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 14:55:54.780087 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.780019 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 14:55:54.780250 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.780229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x42f2\"" Jun 10 14:55:54.780354 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.780285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 14:55:54.903673 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cl59\" (UniqueName: \"kubernetes.io/projected/6c550c2e-8fbf-4e76-92e2-541218712a72-kube-api-access-5cl59\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:54.903673 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a9b156d4-c68a-475d-8e98-361a976522ce-config-volume\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:54.903968 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c550c2e-8fbf-4e76-92e2-541218712a72-cert\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:54.903968 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:54.903968 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gsp2\" (UniqueName: \"kubernetes.io/projected/a9b156d4-c68a-475d-8e98-361a976522ce-kube-api-access-6gsp2\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:54.903968 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:54.903886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9b156d4-c68a-475d-8e98-361a976522ce-tmp-dir\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005041 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9b156d4-c68a-475d-8e98-361a976522ce-tmp-dir\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cl59\" (UniqueName: \"kubernetes.io/projected/6c550c2e-8fbf-4e76-92e2-541218712a72-kube-api-access-5cl59\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a9b156d4-c68a-475d-8e98-361a976522ce-config-volume\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c550c2e-8fbf-4e76-92e2-541218712a72-cert\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gsp2\" (UniqueName: \"kubernetes.io/projected/a9b156d4-c68a-475d-8e98-361a976522ce-kube-api-access-6gsp2\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:55.005361 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9b156d4-c68a-475d-8e98-361a976522ce-tmp-dir\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.005452 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:55.005433 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:55:55.505415488 +0000 UTC m=+35.622975191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:55:55.005762 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.005706 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a9b156d4-c68a-475d-8e98-361a976522ce-config-volume\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.009551 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.009530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c550c2e-8fbf-4e76-92e2-541218712a72-cert\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:55.014201 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.014182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gsp2\" (UniqueName: \"kubernetes.io/projected/a9b156d4-c68a-475d-8e98-361a976522ce-kube-api-access-6gsp2\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.014301 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.014246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cl59\" (UniqueName: \"kubernetes.io/projected/6c550c2e-8fbf-4e76-92e2-541218712a72-kube-api-access-5cl59\") pod \"ingress-canary-r6m96\" (UID: \"6c550c2e-8fbf-4e76-92e2-541218712a72\") " pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:55.086356 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.086321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6m96" Jun 10 14:55:55.253966 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.253923 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6m96"] Jun 10 14:55:55.258576 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:55:55.258547 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c550c2e_8fbf_4e76_92e2_541218712a72.slice/crio-05164c0a934cb4fdebbfa2a24519d1f23cc5d49d963f6d5cdd9153fb87dd03e2 WatchSource:0}: Error finding container 05164c0a934cb4fdebbfa2a24519d1f23cc5d49d963f6d5cdd9153fb87dd03e2: Status 404 returned error can't find the container with id 05164c0a934cb4fdebbfa2a24519d1f23cc5d49d963f6d5cdd9153fb87dd03e2 Jun 10 14:55:55.486692 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.486591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6m96" event={"ID":"6c550c2e-8fbf-4e76-92e2-541218712a72","Type":"ContainerStarted","Data":"05164c0a934cb4fdebbfa2a24519d1f23cc5d49d963f6d5cdd9153fb87dd03e2"} Jun 10 14:55:55.489626 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.489457 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab7d936f-c0b7-4acc-be05-98b108083539" containerID="d3e759c83b4fc357fce527b0e425702a925a4988dcfe7a821a3fbdd1cdf050fd" exitCode=0 Jun 10 14:55:55.489626 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.489547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerDied","Data":"d3e759c83b4fc357fce527b0e425702a925a4988dcfe7a821a3fbdd1cdf050fd"} Jun 10 14:55:55.508955 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:55.508917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:55.509073 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:55.509059 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:55.509116 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:55.509112 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:55:56.509097564 +0000 UTC m=+36.626657266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:55:56.292016 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.291979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:55:56.292602 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.291984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:55:56.292602 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.292111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:55:56.294629 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.294596 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 14:55:56.295697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.295415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 14:55:56.295697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.295431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgr9p\"" Jun 10 14:55:56.295697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.295492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk4k4\"" Jun 10 14:55:56.295697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.295419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 14:55:56.295697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.295536 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 14:55:56.496380 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.496330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" event={"ID":"ab7d936f-c0b7-4acc-be05-98b108083539","Type":"ContainerStarted","Data":"c6a0e483c5f04dfcabecd5f58f56ac1d4b96b835e1dbc765136a5ae38875d3c0"} Jun 10 14:55:56.517094 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.517064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:56.517294 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:56.517171 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:56.517294 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:56.517219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:55:58.517206239 +0000 UTC m=+38.634765940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:55:56.519249 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:56.518670 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6tnqv" podStartSLOduration=8.643742184 podStartE2EDuration="36.518649989s" totalImagesPullingTime="27.874907805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:56.517434302 +0000 UTC m=+36.634994045" watchObservedRunningTime="2026-06-10 14:55:56.518649989 +0000 UTC m=+36.636209714" Jun 10 14:55:58.502381 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:58.502297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6m96" event={"ID":"6c550c2e-8fbf-4e76-92e2-541218712a72","Type":"ContainerStarted","Data":"244a0a0c50e390291e13c98792569531db94fd118d74834de70f00ae68c333cf"} Jun 10 14:55:58.518595 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:58.518547 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r6m96" podStartSLOduration=2.010392113 podStartE2EDuration="4.518532807s" totalImagesPullingTime="2.508140694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:58.517996054 +0000 UTC m=+38.635555799" watchObservedRunningTime="2026-06-10 14:55:58.518532807 +0000 UTC m=+38.636092523" Jun 10 14:55:58.532174 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:55:58.532147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:55:58.532285 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:58.532269 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:58.532327 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:55:58.532318 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:56:02.532304731 +0000 UTC m=+42.649864432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:56:02.561082 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:02.561042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:56:02.561492 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:02.561221 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:02.561492 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:02.561296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:56:10.561277954 +0000 UTC m=+50.678837657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:56:10.618183 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:10.618144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:56:10.618706 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:10.618289 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:10.618706 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:10.618368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:56:26.618351405 +0000 UTC m=+66.735911108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:56:21.720193 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:21.720161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4dhk4" Jun 10 14:56:26.026182 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.026139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:56:26.028840 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.028820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 14:56:26.039442 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.039425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 14:56:26.050529 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.050499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5jh\" (UniqueName: \"kubernetes.io/projected/ba77a1da-2b7c-4077-b451-5cdc93df915d-kube-api-access-2d5jh\") pod \"network-check-target-zns8h\" (UID: \"ba77a1da-2b7c-4077-b451-5cdc93df915d\") " pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:56:26.126650 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.126615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:56:26.126650 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.126653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:56:26.129164 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.129143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 14:56:26.129269 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.129244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 14:56:26.137149 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:26.137132 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 14:56:26.137233 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:26.137188 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:57:30.137173119 +0000 UTC m=+130.254732837 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : secret "metrics-daemon-secret" not found Jun 10 14:56:26.139192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.139173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6b43326-1581-499d-b039-fffb047c730a-original-pull-secret\") pod \"global-pull-secret-syncer-lddgs\" (UID: \"b6b43326-1581-499d-b039-fffb047c730a\") " pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:56:26.304906 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.304831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lddgs" Jun 10 14:56:26.320628 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.320603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk4k4\"" Jun 10 14:56:26.328492 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.328471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:56:26.476090 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.476058 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lddgs"] Jun 10 14:56:26.484254 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:56:26.484228 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b43326_1581_499d_b039_fffb047c730a.slice/crio-e96d87f01ead1dae88dbff4c492b01b3ee0cbb60d84f0241edb15425fb9560e2 WatchSource:0}: Error finding container e96d87f01ead1dae88dbff4c492b01b3ee0cbb60d84f0241edb15425fb9560e2: Status 404 returned error can't find the container with id e96d87f01ead1dae88dbff4c492b01b3ee0cbb60d84f0241edb15425fb9560e2 Jun 10 14:56:26.496038 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.496014 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zns8h"] Jun 10 14:56:26.498995 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:56:26.498971 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba77a1da_2b7c_4077_b451_5cdc93df915d.slice/crio-5181d4785d1593e1482c3c48fb322394553c279505838795e1d83b21cd91b89f WatchSource:0}: Error finding container 5181d4785d1593e1482c3c48fb322394553c279505838795e1d83b21cd91b89f: Status 404 returned error can't find the container with id 5181d4785d1593e1482c3c48fb322394553c279505838795e1d83b21cd91b89f Jun 10 14:56:26.568893 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.568804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lddgs" event={"ID":"b6b43326-1581-499d-b039-fffb047c730a","Type":"ContainerStarted","Data":"e96d87f01ead1dae88dbff4c492b01b3ee0cbb60d84f0241edb15425fb9560e2"} Jun 10 14:56:26.569835 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.569805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zns8h" event={"ID":"ba77a1da-2b7c-4077-b451-5cdc93df915d","Type":"ContainerStarted","Data":"5181d4785d1593e1482c3c48fb322394553c279505838795e1d83b21cd91b89f"} Jun 10 14:56:26.630656 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:26.630625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:56:26.630761 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:26.630746 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:26.630803 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:26.630797 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:56:58.630783437 +0000 UTC m=+98.748343139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:56:31.585810 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:31.585770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lddgs" event={"ID":"b6b43326-1581-499d-b039-fffb047c730a","Type":"ContainerStarted","Data":"c7124312ea897ad5650504b2d189a378b5bbe71552e78a2672d9893634d3046c"} Jun 10 14:56:31.587144 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:31.587118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zns8h" event={"ID":"ba77a1da-2b7c-4077-b451-5cdc93df915d","Type":"ContainerStarted","Data":"ba7b09def4cf7499a8afbf22efc3b589b8c123324d0dfc33e41991e44c9a8cfc"} Jun 10 14:56:31.587277 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:31.587258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:56:31.602483 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:31.602442 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lddgs" podStartSLOduration=67.300791304 podStartE2EDuration="1m11.602429254s" totalImagesPullingTime="4.30163795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:56:31.60205385 +0000 UTC m=+71.719613574" watchObservedRunningTime="2026-06-10 14:56:31.602429254 +0000 UTC m=+71.719988975" Jun 10 14:56:31.619588 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:31.619548 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zns8h" podStartSLOduration=67.338345255 podStartE2EDuration="1m11.619535267s" totalImagesPullingTime="4.281190012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:56:31.618435928 +0000 UTC m=+71.735995665" watchObservedRunningTime="2026-06-10 14:56:31.619535267 +0000 UTC m=+71.737095353" Jun 10 14:56:58.647902 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:56:58.647856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:56:58.648333 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:58.648007 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:58.648333 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:56:58.648065 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 14:58:02.648050183 +0000 UTC m=+162.765609885 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:57:02.592030 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:57:02.592000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zns8h" Jun 10 14:57:30.154545 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:57:30.154506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:57:30.155134 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:57:30.154710 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 14:57:30.155134 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:57:30.154808 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs podName:52e8cd09-60f1-4aa3-9f1f-ba90a4141d29 nodeName:}" failed. No retries permitted until 2026-06-10 14:59:32.154783859 +0000 UTC m=+252.272343564 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs") pod "network-metrics-daemon-xcj2n" (UID: "52e8cd09-60f1-4aa3-9f1f-ba90a4141d29") : secret "metrics-daemon-secret" not found Jun 10 14:57:57.776907 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:57:57.776848 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9ffw9" podUID="a9b156d4-c68a-475d-8e98-361a976522ce" Jun 10 14:57:57.787678 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:57:57.787650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ffw9" Jun 10 14:57:59.311156 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:57:59.311096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xcj2n" podUID="52e8cd09-60f1-4aa3-9f1f-ba90a4141d29" Jun 10 14:58:02.667614 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:02.667530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 14:58:02.668059 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:02.667691 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:58:02.668059 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:02.667774 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls podName:a9b156d4-c68a-475d-8e98-361a976522ce nodeName:}" failed. No retries permitted until 2026-06-10 15:00:04.667756453 +0000 UTC m=+284.785316160 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls") pod "dns-default-9ffw9" (UID: "a9b156d4-c68a-475d-8e98-361a976522ce") : secret "dns-default-metrics-tls" not found Jun 10 14:58:12.292718 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:12.292679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:58:24.095463 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.095431 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr"] Jun 10 14:58:24.097322 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.097306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" Jun 10 14:58:24.099598 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.099578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qpb6s\"" Jun 10 14:58:24.104377 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.104359 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r"] Jun 10 14:58:24.106008 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.105992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.108143 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.108123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 14:58:24.108143 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.108138 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 14:58:24.108386 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.108373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.112613 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.112597 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.117268 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.117248 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr"] Jun 10 14:58:24.121526 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.121492 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r"] Jun 10 14:58:24.216409 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.216376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9p8\" (UniqueName: \"kubernetes.io/projected/9c0dd63d-19b7-4f28-8029-223d941b7a8e-kube-api-access-mp9p8\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.216614 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.216428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz695\" (UniqueName: \"kubernetes.io/projected/af72e2f2-b3b3-4b74-8a21-21214d016210-kube-api-access-sz695\") pod \"network-check-source-dbd9cf844-fvdkr\" (UID: \"af72e2f2-b3b3-4b74-8a21-21214d016210\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" Jun 10 14:58:24.216614 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.216490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c0dd63d-19b7-4f28-8029-223d941b7a8e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.216614 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.216532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c0dd63d-19b7-4f28-8029-223d941b7a8e-tmp\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.258825 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.258794 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67"] Jun 10 14:58:24.260562 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.260546 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.264214 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.264194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 14:58:24.265650 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.265634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tcvzs\"" Jun 10 14:58:24.279141 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.279116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67"] Jun 10 14:58:24.310765 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.310732 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:58:24.312500 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.312485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.316187 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.316158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 14:58:24.316584 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.316550 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 14:58:24.317121 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c0dd63d-19b7-4f28-8029-223d941b7a8e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.317228 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l8pj7\"" Jun 10 14:58:24.317580 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c0dd63d-19b7-4f28-8029-223d941b7a8e-tmp\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.317823 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9p8\" (UniqueName: \"kubernetes.io/projected/9c0dd63d-19b7-4f28-8029-223d941b7a8e-kube-api-access-mp9p8\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.317939 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317625 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c0dd63d-19b7-4f28-8029-223d941b7a8e-tmp\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.317939 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.317851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz695\" (UniqueName: \"kubernetes.io/projected/af72e2f2-b3b3-4b74-8a21-21214d016210-kube-api-access-sz695\") pod \"network-check-source-dbd9cf844-fvdkr\" (UID: \"af72e2f2-b3b3-4b74-8a21-21214d016210\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" Jun 10 14:58:24.320040 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.320017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c0dd63d-19b7-4f28-8029-223d941b7a8e-klusterlet-config\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.320498 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.320477 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 14:58:24.320908 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.320894 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 14:58:24.347525 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.347468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:58:24.356375 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.356350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9p8\" (UniqueName: \"kubernetes.io/projected/9c0dd63d-19b7-4f28-8029-223d941b7a8e-kube-api-access-mp9p8\") pod \"klusterlet-addon-workmgr-78d5b4f9c-25q8r\" (UID: \"9c0dd63d-19b7-4f28-8029-223d941b7a8e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.356802 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.356782 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz695\" (UniqueName: \"kubernetes.io/projected/af72e2f2-b3b3-4b74-8a21-21214d016210-kube-api-access-sz695\") pod \"network-check-source-dbd9cf844-fvdkr\" (UID: \"af72e2f2-b3b3-4b74-8a21-21214d016210\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" Jun 10 14:58:24.406359 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.406322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" Jun 10 14:58:24.414310 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.414289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:24.418339 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvjsl\" (UniqueName: \"kubernetes.io/projected/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-kube-api-access-dvjsl\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.418449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn492\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418543 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418543 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418619 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418619 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418698 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.418744 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.418744 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.418737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.519426 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.519426 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.519631 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:24.519604 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:24.519631 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:24.519616 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:24.519733 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:24.519669 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:25.019648465 +0000 UTC m=+185.137208171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:24.519733 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.519850 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.519850 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.519850 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.520031 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjsl\" (UniqueName: \"kubernetes.io/projected/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-kube-api-access-dvjsl\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.520031 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn492\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.520031 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.519971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.520031 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.520001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.520889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.520473 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.520889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.520538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.522090 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.522066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.522448 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.522423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.522692 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.522674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.523122 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.523074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.535699 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.535652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn492\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.535836 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.535818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvjsl\" (UniqueName: \"kubernetes.io/projected/ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e-kube-api-access-dvjsl\") pod \"managed-serviceaccount-addon-agent-5dbcb647b6-n4x67\" (UID: \"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.536179 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.536160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:24.540349 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.540326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr"] Jun 10 14:58:24.542932 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:24.542910 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf72e2f2_b3b3_4b74_8a21_21214d016210.slice/crio-51cb05e22b3da19ae22b53896e48b556153388d220c87e3d00cff3d81f41efd7 WatchSource:0}: Error finding container 51cb05e22b3da19ae22b53896e48b556153388d220c87e3d00cff3d81f41efd7: Status 404 returned error can't find the container with id 51cb05e22b3da19ae22b53896e48b556153388d220c87e3d00cff3d81f41efd7 Jun 10 14:58:24.557769 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.557746 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r"] Jun 10 14:58:24.569893 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:24.569865 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0dd63d_19b7_4f28_8029_223d941b7a8e.slice/crio-b9aecb2e72905018433918d2c03531f40ede8ff50891f6e6678341b6b8e36cce WatchSource:0}: Error finding container b9aecb2e72905018433918d2c03531f40ede8ff50891f6e6678341b6b8e36cce: Status 404 returned error can't find the container with id b9aecb2e72905018433918d2c03531f40ede8ff50891f6e6678341b6b8e36cce Jun 10 14:58:24.578206 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.578132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" Jun 10 14:58:24.705747 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.705690 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67"] Jun 10 14:58:24.709028 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:24.709002 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec742f9a_7aca_4cf8_8c34_26f0ae3bff1e.slice/crio-af524760ffb7d7760f0f685f82e4a5b89a0e77bc41ffabde4282ba8be9080e60 WatchSource:0}: Error finding container af524760ffb7d7760f0f685f82e4a5b89a0e77bc41ffabde4282ba8be9080e60: Status 404 returned error can't find the container with id af524760ffb7d7760f0f685f82e4a5b89a0e77bc41ffabde4282ba8be9080e60 Jun 10 14:58:24.848248 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.848214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" event={"ID":"9c0dd63d-19b7-4f28-8029-223d941b7a8e","Type":"ContainerStarted","Data":"b9aecb2e72905018433918d2c03531f40ede8ff50891f6e6678341b6b8e36cce"} Jun 10 14:58:24.849719 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.849689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" event={"ID":"af72e2f2-b3b3-4b74-8a21-21214d016210","Type":"ContainerStarted","Data":"b365d8fb821891d55617c3b71dc9fa3f3313357463da1afd1a9c11ea4a3f2e9c"} Jun 10 14:58:24.849884 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.849742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" event={"ID":"af72e2f2-b3b3-4b74-8a21-21214d016210","Type":"ContainerStarted","Data":"51cb05e22b3da19ae22b53896e48b556153388d220c87e3d00cff3d81f41efd7"} Jun 10 14:58:24.850736 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.850715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" event={"ID":"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e","Type":"ContainerStarted","Data":"af524760ffb7d7760f0f685f82e4a5b89a0e77bc41ffabde4282ba8be9080e60"} Jun 10 14:58:24.879110 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:24.879025 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-fvdkr" podStartSLOduration=0.879007622 podStartE2EDuration="879.007622ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:24.878493463 +0000 UTC m=+184.996053186" watchObservedRunningTime="2026-06-10 14:58:24.879007622 +0000 UTC m=+184.996567348" Jun 10 14:58:25.023430 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:25.023375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:25.023635 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:25.023500 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:25.023635 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:25.023514 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:25.023635 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:25.023571 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:26.02355516 +0000 UTC m=+186.141114869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:26.029875 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:26.029834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:26.030349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:26.029983 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:26.030349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:26.029996 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:26.030349 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:26.030047 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:28.030033557 +0000 UTC m=+188.147593272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:28.045114 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:28.045070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:28.045573 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:28.045234 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:28.045573 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:28.045258 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:28.045573 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:28.045323 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:32.045304206 +0000 UTC m=+192.162863923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:30.869032 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.868990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" event={"ID":"9c0dd63d-19b7-4f28-8029-223d941b7a8e","Type":"ContainerStarted","Data":"7d8c09501d8dc6bb5ab2f6bb0d2895400696b44bf4e30730888e9610d13fe65b"} Jun 10 14:58:30.869490 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.869049 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:30.870505 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.870469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" event={"ID":"ec742f9a-7aca-4cf8-8c34-26f0ae3bff1e","Type":"ContainerStarted","Data":"c6686fad9d2a336fd3d5dfbafd6cd7597e5ec4660f0ca086e5e016a39707eb14"} Jun 10 14:58:30.871052 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.871030 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" Jun 10 14:58:30.892937 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.892890 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78d5b4f9c-25q8r" podStartSLOduration=1.445895294 podStartE2EDuration="6.892873789s" totalImagesPullingTime="5.446978495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:30.891446476 +0000 UTC m=+191.009006200" watchObservedRunningTime="2026-06-10 14:58:30.892873789 +0000 UTC m=+191.010433512" Jun 10 14:58:30.912026 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:30.911984 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbcb647b6-n4x67" podStartSLOduration=1.615086657 podStartE2EDuration="6.911973333s" totalImagesPullingTime="5.296886676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:30.91123289 +0000 UTC m=+191.028792615" watchObservedRunningTime="2026-06-10 14:58:30.911973333 +0000 UTC m=+191.029533054" Jun 10 14:58:32.078528 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:32.078490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:32.078896 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:32.078629 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:32.078896 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:32.078647 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:32.078896 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:32.078703 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:40.078688353 +0000 UTC m=+200.196248072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:34.006029 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:34.006004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-clpwq_93e10899-9138-485b-9224-dd474ba6dc37/dns-node-resolver/0.log" Jun 10 14:58:34.995147 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:34.995123 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8d6r2_346f4452-02c4-46f3-b06a-51dbf5c43d27/node-ca/0.log" Jun 10 14:58:35.594795 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:35.594763 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6m96_6c550c2e-8fbf-4e76-92e2-541218712a72/serve-healthcheck-canary/0.log" Jun 10 14:58:40.132682 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:40.132639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:40.133158 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:40.132799 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 14:58:40.133158 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:40.132824 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58899c74f8-7kpg2: secret "image-registry-tls" not found Jun 10 14:58:40.133158 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:58:40.132906 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls podName:045bfe55-3760-4107-80bd-5b141d423a31 nodeName:}" failed. No retries permitted until 2026-06-10 14:58:56.132882799 +0000 UTC m=+216.250442502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls") pod "image-registry-58899c74f8-7kpg2" (UID: "045bfe55-3760-4107-80bd-5b141d423a31") : secret "image-registry-tls" not found Jun 10 14:58:56.151830 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.151783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:56.154234 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.154209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"image-registry-58899c74f8-7kpg2\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:56.429098 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.429015 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:56.623312 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.623279 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:58:56.626437 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:56.626407 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045bfe55_3760_4107_80bd_5b141d423a31.slice/crio-8df558c51dbd0103a9229c89323316fab2f2c6cd82a537df709fca0e7bb32e01 WatchSource:0}: Error finding container 8df558c51dbd0103a9229c89323316fab2f2c6cd82a537df709fca0e7bb32e01: Status 404 returned error can't find the container with id 8df558c51dbd0103a9229c89323316fab2f2c6cd82a537df709fca0e7bb32e01 Jun 10 14:58:56.819714 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.819684 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fh7kg"] Jun 10 14:58:56.843337 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.843240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.845053 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.845024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fh7kg"] Jun 10 14:58:56.845830 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.845811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 14:58:56.845986 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.845964 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:58:56.846235 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.846220 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 14:58:56.846296 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.846255 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 14:58:56.846570 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.846553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 14:58:56.846821 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.846808 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zk2n\"" Jun 10 14:58:56.911422 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.911392 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fd48d9b75-5h8jc"] Jun 10 14:58:56.916706 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.916683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.925913 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.925889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd48d9b75-5h8jc"] Jun 10 14:58:56.946895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.946816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" event={"ID":"045bfe55-3760-4107-80bd-5b141d423a31","Type":"ContainerStarted","Data":"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75"} Jun 10 14:58:56.946895 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.946875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" event={"ID":"045bfe55-3760-4107-80bd-5b141d423a31","Type":"ContainerStarted","Data":"8df558c51dbd0103a9229c89323316fab2f2c6cd82a537df709fca0e7bb32e01"} Jun 10 14:58:56.947071 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.946904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:58:56.957418 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vt4\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-kube-api-access-m4vt4\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-tls\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-ca-trust-extracted\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e157223-5df6-4178-b6b5-a7b4c907585e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e157223-5df6-4178-b6b5-a7b4c907585e-crio-socket\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-certificates\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957552 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-trusted-ca\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-image-registry-private-configuration\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7q2h\" (UniqueName: \"kubernetes.io/projected/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-api-access-p7q2h\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e157223-5df6-4178-b6b5-a7b4c907585e-data-volume\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-installation-pull-secrets\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.957843 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.957799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-bound-sa-token\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:56.997180 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:56.997129 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" podStartSLOduration=32.997111406 podStartE2EDuration="32.997111406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:56.995978552 +0000 UTC m=+217.113538276" watchObservedRunningTime="2026-06-10 14:58:56.997111406 +0000 UTC m=+217.114671130" Jun 10 14:58:57.058545 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e157223-5df6-4178-b6b5-a7b4c907585e-crio-socket\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.058545 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-certificates\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.058791 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e157223-5df6-4178-b6b5-a7b4c907585e-crio-socket\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.058791 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-trusted-ca\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.058791 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-image-registry-private-configuration\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.058965 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7q2h\" (UniqueName: \"kubernetes.io/projected/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-api-access-p7q2h\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.058965 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e157223-5df6-4178-b6b5-a7b4c907585e-data-volume\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.058965 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.058965 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.058931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-installation-pull-secrets\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.059170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-bound-sa-token\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.059170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vt4\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-kube-api-access-m4vt4\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.059170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-tls\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.059170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-ca-trust-extracted\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.059170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e157223-5df6-4178-b6b5-a7b4c907585e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.060095 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-certificates\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.060095 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-trusted-ca\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.060095 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.059736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e157223-5df6-4178-b6b5-a7b4c907585e-data-volume\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.060344 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.060153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.060344 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.060257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-ca-trust-extracted\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.061734 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.061698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-installation-pull-secrets\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.061936 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.061919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e157223-5df6-4178-b6b5-a7b4c907585e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.062151 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.062135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-registry-tls\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.062216 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.062176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-image-registry-private-configuration\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.068499 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.068478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vt4\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-kube-api-access-m4vt4\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.068630 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.068607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b65a7f8-2fcf-4f98-a051-0e1936f86e22-bound-sa-token\") pod \"image-registry-6fd48d9b75-5h8jc\" (UID: \"2b65a7f8-2fcf-4f98-a051-0e1936f86e22\") " pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.069278 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.069257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7q2h\" (UniqueName: \"kubernetes.io/projected/0e157223-5df6-4178-b6b5-a7b4c907585e-kube-api-access-p7q2h\") pod \"insights-runtime-extractor-fh7kg\" (UID: \"0e157223-5df6-4178-b6b5-a7b4c907585e\") " pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.153496 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.153466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fh7kg" Jun 10 14:58:57.225209 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.225009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.306781 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.306673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fh7kg"] Jun 10 14:58:57.309547 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:57.309513 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e157223_5df6_4178_b6b5_a7b4c907585e.slice/crio-515b7282b0ffc892b6d1201a9c8162f2978c1d802c246013faa354e0f8cdd6d7 WatchSource:0}: Error finding container 515b7282b0ffc892b6d1201a9c8162f2978c1d802c246013faa354e0f8cdd6d7: Status 404 returned error can't find the container with id 515b7282b0ffc892b6d1201a9c8162f2978c1d802c246013faa354e0f8cdd6d7 Jun 10 14:58:57.366374 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.366328 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd48d9b75-5h8jc"] Jun 10 14:58:57.369320 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:58:57.369290 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b65a7f8_2fcf_4f98_a051_0e1936f86e22.slice/crio-b62b33fcbad0a955bde0ca232fc2928e8ce93aecd2663b5728076df2a5fa2412 WatchSource:0}: Error finding container b62b33fcbad0a955bde0ca232fc2928e8ce93aecd2663b5728076df2a5fa2412: Status 404 returned error can't find the container with id b62b33fcbad0a955bde0ca232fc2928e8ce93aecd2663b5728076df2a5fa2412 Jun 10 14:58:57.951431 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.951391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh7kg" event={"ID":"0e157223-5df6-4178-b6b5-a7b4c907585e","Type":"ContainerStarted","Data":"b6e06b9b828ad66b4b4aacc6353cc7e45ce9c7380130a38c3b66278ad48c31f9"} Jun 10 14:58:57.951615 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.951478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh7kg" event={"ID":"0e157223-5df6-4178-b6b5-a7b4c907585e","Type":"ContainerStarted","Data":"515b7282b0ffc892b6d1201a9c8162f2978c1d802c246013faa354e0f8cdd6d7"} Jun 10 14:58:57.953312 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.953251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" event={"ID":"2b65a7f8-2fcf-4f98-a051-0e1936f86e22","Type":"ContainerStarted","Data":"c7fc19fb2a52be19a5998d2160dc98356890df1e9daa2c8ac7b733b38dd97c26"} Jun 10 14:58:57.953312 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.953300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" event={"ID":"2b65a7f8-2fcf-4f98-a051-0e1936f86e22","Type":"ContainerStarted","Data":"b62b33fcbad0a955bde0ca232fc2928e8ce93aecd2663b5728076df2a5fa2412"} Jun 10 14:58:57.953531 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.953413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:58:57.978058 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:57.978010 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podStartSLOduration=1.977995361 podStartE2EDuration="1.977995361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:57.976666166 +0000 UTC m=+218.094225891" watchObservedRunningTime="2026-06-10 14:58:57.977995361 +0000 UTC m=+218.095555084" Jun 10 14:58:58.958328 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:58.958289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh7kg" event={"ID":"0e157223-5df6-4178-b6b5-a7b4c907585e","Type":"ContainerStarted","Data":"e9ecf1ff2b0a19332913383c0b5887887f0407810531bc317ecf12526387ed3b"} Jun 10 14:58:59.966773 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:59.966691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh7kg" event={"ID":"0e157223-5df6-4178-b6b5-a7b4c907585e","Type":"ContainerStarted","Data":"9415c04d0a72a1c58e33661f0581993befd3a72c64b81f7f45c1ae6b132f8a29"} Jun 10 14:58:59.994770 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:58:59.994724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fh7kg" podStartSLOduration=1.8262713769999999 podStartE2EDuration="3.994709075s" totalImagesPullingTime="2.168437698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:58:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:59.993888991 +0000 UTC m=+220.111448714" watchObservedRunningTime="2026-06-10 14:58:59.994709075 +0000 UTC m=+220.112268800" Jun 10 14:59:05.838382 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.838343 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2"] Jun 10 14:59:05.843214 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.843192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.846478 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.846459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 14:59:05.849609 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.849582 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 14:59:05.849732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.849608 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 14:59:05.849732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.849630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2zs48\"" Jun 10 14:59:05.850200 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.849961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 14:59:05.851024 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.851009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 14:59:05.857493 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.857477 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 14:59:05.877196 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.877162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2"] Jun 10 14:59:05.899144 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.899119 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v8t8r"] Jun 10 14:59:05.902122 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.902107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:05.905143 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.905125 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rqml\"" Jun 10 14:59:05.905241 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.905220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 14:59:05.905297 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.905220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 14:59:05.906170 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.906153 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 14:59:05.927734 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.927872 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.927872 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.927872 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.928062 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8a42d78-c1c8-484c-965c-5ff14b1b5414-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:05.928062 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:05.927936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgs2g\" (UniqueName: \"kubernetes.io/projected/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-api-access-mgs2g\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028338 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028338 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-textfile\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-metrics-client-ca\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkx99\" (UniqueName: \"kubernetes.io/projected/6c45914d-a1f6-42e7-894a-123012ab5033-kube-api-access-xkx99\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8a42d78-c1c8-484c-965c-5ff14b1b5414-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgs2g\" (UniqueName: \"kubernetes.io/projected/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-api-access-mgs2g\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-sys\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-root\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.028725 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-tls\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.029197 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-wtmp\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.029197 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.028822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8a42d78-c1c8-484c-965c-5ff14b1b5414-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.029197 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.029121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.029296 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.029282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.030798 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.030776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.030925 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.030907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.038406 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.038382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgs2g\" (UniqueName: \"kubernetes.io/projected/e8a42d78-c1c8-484c-965c-5ff14b1b5414-kube-api-access-mgs2g\") pod \"kube-state-metrics-57bbf8bfb5-df4t2\" (UID: \"e8a42d78-c1c8-484c-965c-5ff14b1b5414\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.129633 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-metrics-client-ca\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129633 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkx99\" (UniqueName: \"kubernetes.io/projected/6c45914d-a1f6-42e7-894a-123012ab5033-kube-api-access-xkx99\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-sys\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-root\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-tls\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-wtmp\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-textfile\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.129822 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-sys\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130182 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-root\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130182 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-wtmp\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130182 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.129901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130182 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.130091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-textfile\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130357 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.130200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-metrics-client-ca\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.130357 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.130258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.132026 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.132004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.132106 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.132081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c45914d-a1f6-42e7-894a-123012ab5033-node-exporter-tls\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.139051 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.139030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkx99\" (UniqueName: \"kubernetes.io/projected/6c45914d-a1f6-42e7-894a-123012ab5033-kube-api-access-xkx99\") pod \"node-exporter-v8t8r\" (UID: \"6c45914d-a1f6-42e7-894a-123012ab5033\") " pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.153017 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.152997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" Jun 10 14:59:06.210710 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.210681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8t8r" Jun 10 14:59:06.224519 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:06.224489 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c45914d_a1f6_42e7_894a_123012ab5033.slice/crio-bea56d5fe516e7bdb35e0ef19a2221fdd419c7752874e9e60f776c3945fa52c9 WatchSource:0}: Error finding container bea56d5fe516e7bdb35e0ef19a2221fdd419c7752874e9e60f776c3945fa52c9: Status 404 returned error can't find the container with id bea56d5fe516e7bdb35e0ef19a2221fdd419c7752874e9e60f776c3945fa52c9 Jun 10 14:59:06.285005 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.284977 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2"] Jun 10 14:59:06.287816 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:06.287781 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a42d78_c1c8_484c_965c_5ff14b1b5414.slice/crio-f89beecdc1d7c73e61cacd73a43b08d7b0962fec48a840bd37fa55a20819822b WatchSource:0}: Error finding container f89beecdc1d7c73e61cacd73a43b08d7b0962fec48a840bd37fa55a20819822b: Status 404 returned error can't find the container with id f89beecdc1d7c73e61cacd73a43b08d7b0962fec48a840bd37fa55a20819822b Jun 10 14:59:06.975795 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.975766 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 14:59:06.980238 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.980213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:06.985418 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 14:59:06.985418 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985330 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 14:59:06.985418 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985330 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 14:59:06.985649 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 14:59:06.985703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 14:59:06.985703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985691 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 14:59:06.985914 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.985883 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 14:59:06.986907 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.986881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mzbg8\"" Jun 10 14:59:06.989609 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.989589 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 14:59:06.989881 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.989864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 14:59:06.990429 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.990393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" event={"ID":"e8a42d78-c1c8-484c-965c-5ff14b1b5414","Type":"ContainerStarted","Data":"f89beecdc1d7c73e61cacd73a43b08d7b0962fec48a840bd37fa55a20819822b"} Jun 10 14:59:06.991929 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:06.991896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8t8r" event={"ID":"6c45914d-a1f6-42e7-894a-123012ab5033","Type":"ContainerStarted","Data":"bea56d5fe516e7bdb35e0ef19a2221fdd419c7752874e9e60f776c3945fa52c9"} Jun 10 14:59:07.012995 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.012966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 14:59:07.036449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036538 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036538 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036639 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036639 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036639 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036771 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036771 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszrz\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036868 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036868 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036975 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036975 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.036975 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.036966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138297 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138477 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszrz\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138477 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138477 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138477 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138477 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.138732 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.138672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.139114 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.139083 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.139649 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.139624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.141128 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.140827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.141712 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.141664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.142295 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.142248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.143693 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.143651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.144235 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.144205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.144336 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.144274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.144547 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.144520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.144633 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.144576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.144920 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.144895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.146917 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.146891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.150093 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.150061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszrz\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz\") pod \"alertmanager-main-0\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.292205 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.292129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 14:59:07.696198 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.696172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 14:59:07.699341 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:07.699316 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ffd665_7297_457d_8829_61805b6ba436.slice/crio-285f2718d31e14c155100b961273da7d9181296d2596b0d55823a09ffc727867 WatchSource:0}: Error finding container 285f2718d31e14c155100b961273da7d9181296d2596b0d55823a09ffc727867: Status 404 returned error can't find the container with id 285f2718d31e14c155100b961273da7d9181296d2596b0d55823a09ffc727867 Jun 10 14:59:07.997921 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.997880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" event={"ID":"e8a42d78-c1c8-484c-965c-5ff14b1b5414","Type":"ContainerStarted","Data":"1763fd120d7cb6acc1b91f100c2e2134bf4b07d7a80a30532201d2672e4c1d1d"} Jun 10 14:59:07.998379 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.997980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" event={"ID":"e8a42d78-c1c8-484c-965c-5ff14b1b5414","Type":"ContainerStarted","Data":"cd9f08c75a08e8a8f5fdbf9e1310d2ac57fa9479a214f3f401642f58bd004b89"} Jun 10 14:59:07.998379 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.998009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" event={"ID":"e8a42d78-c1c8-484c-965c-5ff14b1b5414","Type":"ContainerStarted","Data":"ffc2287b161e6f1eec0e301b9873d653a71a6d769ab929413c9c2f512fcdf484"} Jun 10 14:59:07.999434 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.999407 2578 generic.go:356] "Generic (PLEG): container finished" podID="6c45914d-a1f6-42e7-894a-123012ab5033" containerID="da35167ffc97393586cb2b9a9dde8cb4793cb23667356e1899a1dfeaeed3eba5" exitCode=0 Jun 10 14:59:07.999559 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:07.999485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8t8r" event={"ID":"6c45914d-a1f6-42e7-894a-123012ab5033","Type":"ContainerDied","Data":"da35167ffc97393586cb2b9a9dde8cb4793cb23667356e1899a1dfeaeed3eba5"} Jun 10 14:59:08.000702 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:08.000683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"285f2718d31e14c155100b961273da7d9181296d2596b0d55823a09ffc727867"} Jun 10 14:59:08.025496 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:08.025419 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-df4t2" podStartSLOduration=1.711218872 podStartE2EDuration="3.025399883s" totalImagesPullingTime="1.314181011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:08.019043768 +0000 UTC m=+228.136603493" watchObservedRunningTime="2026-06-10 14:59:08.025399883 +0000 UTC m=+228.142959586" Jun 10 14:59:09.005448 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:09.005359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8t8r" event={"ID":"6c45914d-a1f6-42e7-894a-123012ab5033","Type":"ContainerStarted","Data":"9805f8e80ea409d3240872a761e0fbd78c832f24b6f8d7fd0ce2161533e1c527"} Jun 10 14:59:09.005448 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:09.005418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8t8r" event={"ID":"6c45914d-a1f6-42e7-894a-123012ab5033","Type":"ContainerStarted","Data":"439f741cf4cf2865c61b7d98b570a17aaa093aae0e5ca89b980c0e5692ae4dec"} Jun 10 14:59:09.006823 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:09.006798 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351" exitCode=0 Jun 10 14:59:09.006979 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:09.006882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351"} Jun 10 14:59:09.036409 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:09.036360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v8t8r" podStartSLOduration=3.158432955 podStartE2EDuration="4.036345355s" totalImagesPullingTime="798.092111ms" totalInitContainerRuntime="79.820289ms" isStatefulPod=true podCreationTimestamp="2026-06-10 14:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:09.035773192 +0000 UTC m=+229.153332929" watchObservedRunningTime="2026-06-10 14:59:09.036345355 +0000 UTC m=+229.153905078" Jun 10 14:59:11.017717 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.017670 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205"} Jun 10 14:59:11.018177 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.017784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21"} Jun 10 14:59:11.018177 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.017822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03"} Jun 10 14:59:11.018177 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.017848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78"} Jun 10 14:59:11.018177 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.017870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f"} Jun 10 14:59:11.140287 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.140256 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c775669b4-dmzrm"] Jun 10 14:59:11.143499 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.143482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.147102 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.147080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 14:59:11.147102 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.147087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 14:59:11.147263 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.147139 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jfgpd\"" Jun 10 14:59:11.147430 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.147414 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 14:59:11.147505 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.147436 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 14:59:11.148091 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.148076 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 14:59:11.152357 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.152331 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 14:59:11.162460 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.162432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c775669b4-dmzrm"] Jun 10 14:59:11.290026 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.289935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290026 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-metrics-client-ca\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-federate-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290192 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-serving-certs-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.290348 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.290222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khm6b\" (UniqueName: \"kubernetes.io/projected/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-kube-api-access-khm6b\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391426 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-federate-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391426 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-serving-certs-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khm6b\" (UniqueName: \"kubernetes.io/projected/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-kube-api-access-khm6b\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-metrics-client-ca\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.391655 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.391604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.392272 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.392244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-serving-certs-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.392394 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.392362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-metrics-client-ca\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.392588 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.392562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.394053 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.394028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-federate-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.394169 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.394100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.394251 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.394210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-telemeter-client-tls\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.394307 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.394274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-secret-telemeter-client\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.400633 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.400604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khm6b\" (UniqueName: \"kubernetes.io/projected/dfcd534f-4854-46a6-bb5a-1ab7b2414b7b-kube-api-access-khm6b\") pod \"telemeter-client-7c775669b4-dmzrm\" (UID: \"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b\") " pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.453374 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.453354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" Jun 10 14:59:11.591971 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:11.591926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c775669b4-dmzrm"] Jun 10 14:59:11.594982 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:11.594958 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcd534f_4854_46a6_bb5a_1ab7b2414b7b.slice/crio-27a0331b26c658f9430cf9a0e8d4ba0baa5148a83c7f04c5eefc82cd5b018523 WatchSource:0}: Error finding container 27a0331b26c658f9430cf9a0e8d4ba0baa5148a83c7f04c5eefc82cd5b018523: Status 404 returned error can't find the container with id 27a0331b26c658f9430cf9a0e8d4ba0baa5148a83c7f04c5eefc82cd5b018523 Jun 10 14:59:12.025298 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:12.025213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerStarted","Data":"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6"} Jun 10 14:59:12.026367 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:12.026343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" event={"ID":"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b","Type":"ContainerStarted","Data":"27a0331b26c658f9430cf9a0e8d4ba0baa5148a83c7f04c5eefc82cd5b018523"} Jun 10 14:59:12.064403 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:12.064347 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8709165739999998 podStartE2EDuration="6.064331371s" totalImagesPullingTime="3.173902467s" totalInitContainerRuntime="19.51233ms" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:12.062567806 +0000 UTC m=+232.180127555" watchObservedRunningTime="2026-06-10 14:59:12.064331371 +0000 UTC m=+232.181891140" Jun 10 14:59:14.036385 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:14.036347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" event={"ID":"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b","Type":"ContainerStarted","Data":"2a9d215c1c810a7e891d365641d4185aed4e996ebde5668359753f08e12b87a3"} Jun 10 14:59:14.036738 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:14.036446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" event={"ID":"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b","Type":"ContainerStarted","Data":"b3ef3946d1b1545b94be9ebe7e345ad1b921f27244a1bf1bd8672be17bdbc56c"} Jun 10 14:59:14.036738 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:14.036476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" event={"ID":"dfcd534f-4854-46a6-bb5a-1ab7b2414b7b","Type":"ContainerStarted","Data":"8f33fa1cd3061bfee9f457a42f6f0adddca49aa46890b8e203786f3d01efbbde"} Jun 10 14:59:14.061185 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:14.061133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c775669b4-dmzrm" podStartSLOduration=1.318227585 podStartE2EDuration="3.061117272s" totalImagesPullingTime="1.742889687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:14.059988662 +0000 UTC m=+234.177548383" watchObservedRunningTime="2026-06-10 14:59:14.061117272 +0000 UTC m=+234.178676996" Jun 10 14:59:17.229780 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:17.229749 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:17.230163 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:17.229799 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:17.958532 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:17.958496 2578 patch_prober.go:28] interesting pod/image-registry-58899c74f8-7kpg2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:17.958697 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:17.958550 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" podUID="045bfe55-3760-4107-80bd-5b141d423a31" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:18.962979 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:18.962930 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:18.963348 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:18.962995 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:19.053724 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.053690 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-sjbzs"] Jun 10 14:59:19.056057 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.056041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:19.058454 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.058433 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zd62l\"" Jun 10 14:59:19.059062 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.059046 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 14:59:19.059414 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.059400 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 14:59:19.076689 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.076661 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-sjbzs"] Jun 10 14:59:19.160766 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.160732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znpgg\" (UniqueName: \"kubernetes.io/projected/ee654d00-fba7-4dee-be4c-9a8388eb9811-kube-api-access-znpgg\") pod \"downloads-6657875f97-sjbzs\" (UID: \"ee654d00-fba7-4dee-be4c-9a8388eb9811\") " pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:19.261550 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.261462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znpgg\" (UniqueName: \"kubernetes.io/projected/ee654d00-fba7-4dee-be4c-9a8388eb9811-kube-api-access-znpgg\") pod \"downloads-6657875f97-sjbzs\" (UID: \"ee654d00-fba7-4dee-be4c-9a8388eb9811\") " pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:19.273262 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.273237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znpgg\" (UniqueName: \"kubernetes.io/projected/ee654d00-fba7-4dee-be4c-9a8388eb9811-kube-api-access-znpgg\") pod \"downloads-6657875f97-sjbzs\" (UID: \"ee654d00-fba7-4dee-be4c-9a8388eb9811\") " pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:19.365493 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.365454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:19.497798 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:19.497768 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-sjbzs"] Jun 10 14:59:19.500435 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:19.500408 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee654d00_fba7_4dee_be4c_9a8388eb9811.slice/crio-4be55d97dc8171d6197553a0a311da981222a24c2820a5750550134f3892a3b4 WatchSource:0}: Error finding container 4be55d97dc8171d6197553a0a311da981222a24c2820a5750550134f3892a3b4: Status 404 returned error can't find the container with id 4be55d97dc8171d6197553a0a311da981222a24c2820a5750550134f3892a3b4 Jun 10 14:59:20.058718 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:20.058682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-sjbzs" event={"ID":"ee654d00-fba7-4dee-be4c-9a8388eb9811","Type":"ContainerStarted","Data":"4be55d97dc8171d6197553a0a311da981222a24c2820a5750550134f3892a3b4"} Jun 10 14:59:22.975371 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:22.975332 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" podUID="045bfe55-3760-4107-80bd-5b141d423a31" containerName="registry" containerID="cri-o://49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75" gracePeriod=30 Jun 10 14:59:23.220685 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.220658 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:59:23.398391 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398358 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398592 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398409 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn492\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398592 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398441 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398592 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398485 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398592 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398516 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398800 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398593 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398800 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398621 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.398800 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.398646 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration\") pod \"045bfe55-3760-4107-80bd-5b141d423a31\" (UID: \"045bfe55-3760-4107-80bd-5b141d423a31\") " Jun 10 14:59:23.399245 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.399026 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 14:59:23.399245 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.399064 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 14:59:23.401564 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.401530 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492" (OuterVolumeSpecName: "kube-api-access-rn492") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "kube-api-access-rn492". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 14:59:23.401686 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.401622 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 14:59:23.401737 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.401708 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 14:59:23.401838 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.401813 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 14:59:23.402861 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.402839 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 14:59:23.409512 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.409484 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "045bfe55-3760-4107-80bd-5b141d423a31" (UID: "045bfe55-3760-4107-80bd-5b141d423a31"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 14:59:23.499504 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499469 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-registry-tls\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499504 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499502 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/045bfe55-3760-4107-80bd-5b141d423a31-ca-trust-extracted\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499516 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-image-registry-private-configuration\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499529 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-bound-sa-token\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499540 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn492\" (UniqueName: \"kubernetes.io/projected/045bfe55-3760-4107-80bd-5b141d423a31-kube-api-access-rn492\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499551 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-registry-certificates\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499562 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/045bfe55-3760-4107-80bd-5b141d423a31-installation-pull-secrets\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:23.499703 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:23.499573 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/045bfe55-3760-4107-80bd-5b141d423a31-trusted-ca\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 14:59:24.074030 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.073993 2578 generic.go:356] "Generic (PLEG): container finished" podID="045bfe55-3760-4107-80bd-5b141d423a31" containerID="49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75" exitCode=0 Jun 10 14:59:24.074030 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.074029 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" Jun 10 14:59:24.074431 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.074051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" event={"ID":"045bfe55-3760-4107-80bd-5b141d423a31","Type":"ContainerDied","Data":"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75"} Jun 10 14:59:24.074431 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.074101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58899c74f8-7kpg2" event={"ID":"045bfe55-3760-4107-80bd-5b141d423a31","Type":"ContainerDied","Data":"8df558c51dbd0103a9229c89323316fab2f2c6cd82a537df709fca0e7bb32e01"} Jun 10 14:59:24.074431 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.074127 2578 scope.go:117] "RemoveContainer" containerID="49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75" Jun 10 14:59:24.082513 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.082498 2578 scope.go:117] "RemoveContainer" containerID="49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75" Jun 10 14:59:24.082760 ip-10-0-138-72 kubenswrapper[2578]: E0610 14:59:24.082739 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75\": container with ID starting with 49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75 not found: ID does not exist" containerID="49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75" Jun 10 14:59:24.082810 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.082769 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75"} err="failed to get container status \"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75\": rpc error: code = NotFound desc = could not find container \"49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75\": container with ID starting with 49ebd40bbc9926d85d93aa9807c575f373a132fb972ab27e146fbf13b3835d75 not found: ID does not exist" Jun 10 14:59:24.094121 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.094094 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:59:24.097778 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.097758 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58899c74f8-7kpg2"] Jun 10 14:59:24.297761 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:24.297728 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045bfe55-3760-4107-80bd-5b141d423a31" path="/var/lib/kubelet/pods/045bfe55-3760-4107-80bd-5b141d423a31/volumes" Jun 10 14:59:27.230633 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:27.230599 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:27.231110 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:27.230656 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:28.963124 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:28.963080 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:28.963476 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:28.963134 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:29.748201 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.748172 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 14:59:29.748449 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.748437 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045bfe55-3760-4107-80bd-5b141d423a31" containerName="registry" Jun 10 14:59:29.748502 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.748451 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="045bfe55-3760-4107-80bd-5b141d423a31" containerName="registry" Jun 10 14:59:29.748502 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.748500 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="045bfe55-3760-4107-80bd-5b141d423a31" containerName="registry" Jun 10 14:59:29.754159 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.754138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.758502 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.758481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 14:59:29.758640 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.758536 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 14:59:29.759580 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.759528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6252z\"" Jun 10 14:59:29.759580 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.759568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 14:59:29.759747 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.759587 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 14:59:29.759747 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.759533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 14:59:29.764021 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.764001 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 14:59:29.953120 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.953286 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.953286 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.953351 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.953351 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4696\" (UniqueName: \"kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:29.953407 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:29.953348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054400 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054400 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054862 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054862 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4696\" (UniqueName: \"kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054862 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.054862 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.054519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.055288 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.055238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.055397 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.055286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.055397 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.055301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.057087 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.057051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.057314 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.057288 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.064795 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.064750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4696\" (UniqueName: \"kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696\") pod \"console-8596f8dc9d-zc4fh\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.364010 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.363975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:30.500611 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:30.500577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 14:59:30.504786 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:30.504755 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d66299_0660_4a9d_8fe7_81932a77383a.slice/crio-6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee WatchSource:0}: Error finding container 6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee: Status 404 returned error can't find the container with id 6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee Jun 10 14:59:31.109640 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:31.109602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596f8dc9d-zc4fh" event={"ID":"35d66299-0660-4a9d-8fe7-81932a77383a","Type":"ContainerStarted","Data":"6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee"} Jun 10 14:59:32.175265 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:32.175059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:59:32.177912 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:32.177885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52e8cd09-60f1-4aa3-9f1f-ba90a4141d29-metrics-certs\") pod \"network-metrics-daemon-xcj2n\" (UID: \"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29\") " pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:59:32.396183 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:32.396137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgr9p\"" Jun 10 14:59:32.404381 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:32.404348 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcj2n" Jun 10 14:59:37.230119 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.230082 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:37.230670 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.230135 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:37.230670 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.230179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 14:59:37.230802 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.230692 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"c7fc19fb2a52be19a5998d2160dc98356890df1e9daa2c8ac7b733b38dd97c26"} pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 14:59:37.234771 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.234746 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:37.234891 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:37.234789 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:40.145462 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.145407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596f8dc9d-zc4fh" event={"ID":"35d66299-0660-4a9d-8fe7-81932a77383a","Type":"ContainerStarted","Data":"bf00b244f73f03051259e293dbfcf5cf811a0856ead6e396d0b31e103cddeb1f"} Jun 10 14:59:40.163784 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.163748 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcj2n"] Jun 10 14:59:40.166853 ip-10-0-138-72 kubenswrapper[2578]: W0610 14:59:40.166812 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e8cd09_60f1_4aa3_9f1f_ba90a4141d29.slice/crio-198792ea4500c74ff7f8b2d164112104234f21c78795300e3b0bd2917dd1544c WatchSource:0}: Error finding container 198792ea4500c74ff7f8b2d164112104234f21c78795300e3b0bd2917dd1544c: Status 404 returned error can't find the container with id 198792ea4500c74ff7f8b2d164112104234f21c78795300e3b0bd2917dd1544c Jun 10 14:59:40.167032 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.166990 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8596f8dc9d-zc4fh" podStartSLOduration=1.639247723 podStartE2EDuration="11.166973219s" totalImagesPullingTime="9.527725496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:40.166302092 +0000 UTC m=+260.283861816" watchObservedRunningTime="2026-06-10 14:59:40.166973219 +0000 UTC m=+260.284532936" Jun 10 14:59:40.364570 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.364538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:40.364727 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.364591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 14:59:40.365554 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.365523 2578 patch_prober.go:28] interesting pod/console-8596f8dc9d-zc4fh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 10 14:59:40.365665 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:40.365585 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8596f8dc9d-zc4fh" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 10 14:59:41.153624 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:41.153496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-sjbzs" event={"ID":"ee654d00-fba7-4dee-be4c-9a8388eb9811","Type":"ContainerStarted","Data":"55ecbea09cb1c849b4eed549d5c9d61df8919cbccbd4dc9e23918498adfaf26e"} Jun 10 14:59:41.154378 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:41.154129 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:41.156430 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:41.156397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcj2n" event={"ID":"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29","Type":"ContainerStarted","Data":"198792ea4500c74ff7f8b2d164112104234f21c78795300e3b0bd2917dd1544c"} Jun 10 14:59:41.171696 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:41.171666 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-sjbzs" Jun 10 14:59:41.175867 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:41.175781 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-sjbzs" podStartSLOduration=1.6029150460000001 podStartE2EDuration="22.175762814s" totalImagesPullingTime="20.572847768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:41.17381377 +0000 UTC m=+261.291373506" watchObservedRunningTime="2026-06-10 14:59:41.175762814 +0000 UTC m=+261.293322537" Jun 10 14:59:42.162728 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:42.162673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcj2n" event={"ID":"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29","Type":"ContainerStarted","Data":"512df2812e2334654a46c99b69bed4d2e7bd68b6b449461faf6a15fb13b0dc42"} Jun 10 14:59:42.163221 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:42.162758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcj2n" event={"ID":"52e8cd09-60f1-4aa3-9f1f-ba90a4141d29","Type":"ContainerStarted","Data":"da87b5a753526eb455da532063a273ccd0679a472f57c7abc63c2e9e0cd67854"} Jun 10 14:59:42.183413 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:42.183348 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xcj2n" podStartSLOduration=261.269133684 podStartE2EDuration="4m22.183325287s" totalImagesPullingTime="914.191603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:42.181710539 +0000 UTC m=+262.299270275" watchObservedRunningTime="2026-06-10 14:59:42.183325287 +0000 UTC m=+262.300885095" Jun 10 14:59:47.235861 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:47.235825 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:47.236365 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:47.235881 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:49.436889 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:49.436861 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/init-config-reloader/0.log" Jun 10 14:59:49.636792 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:49.636763 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/alertmanager/0.log" Jun 10 14:59:49.836746 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:49.836721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/config-reloader/0.log" Jun 10 14:59:50.036458 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.036432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/kube-rbac-proxy-web/0.log" Jun 10 14:59:50.235135 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.235068 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/kube-rbac-proxy/0.log" Jun 10 14:59:50.365130 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.365100 2578 patch_prober.go:28] interesting pod/console-8596f8dc9d-zc4fh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 10 14:59:50.365290 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.365146 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8596f8dc9d-zc4fh" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 10 14:59:50.436252 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.436226 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/kube-rbac-proxy-metric/0.log" Jun 10 14:59:50.640912 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:50.640881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ffd665-7297-457d-8829-61805b6ba436/prom-label-proxy/0.log" Jun 10 14:59:51.036486 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:51.036411 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-state-metrics/0.log" Jun 10 14:59:51.237044 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:51.237015 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-rbac-proxy-main/0.log" Jun 10 14:59:51.437081 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:51.437054 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-rbac-proxy-self/0.log" Jun 10 14:59:52.639584 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:52.639553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/init-textfile/0.log" Jun 10 14:59:52.838694 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:52.838668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/node-exporter/0.log" Jun 10 14:59:53.039672 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:53.039600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/kube-rbac-proxy/0.log" Jun 10 14:59:56.435836 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:56.435803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/telemeter-client/0.log" Jun 10 14:59:56.635875 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:56.635846 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/reload/0.log" Jun 10 14:59:56.840049 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:56.840022 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/kube-rbac-proxy/0.log" Jun 10 14:59:57.235239 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:57.235160 2578 patch_prober.go:28] interesting pod/image-registry-6fd48d9b75-5h8jc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 14:59:57.235239 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:57.235207 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 14:59:59.013263 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:59.013224 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 14:59:59.050797 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:59.050766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8596f8dc9d-zc4fh_35d66299-0660-4a9d-8fe7-81932a77383a/console/0.log" Jun 10 14:59:59.238874 ip-10-0-138-72 kubenswrapper[2578]: I0610 14:59:59.238842 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-sjbzs_ee654d00-fba7-4dee-be4c-9a8388eb9811/download-server/0.log" Jun 10 15:00:00.788936 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:00.788891 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9ffw9" podUID="a9b156d4-c68a-475d-8e98-361a976522ce" Jun 10 15:00:00.838338 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:00.838310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-clpwq_93e10899-9138-485b-9224-dd474ba6dc37/dns-node-resolver/0.log" Jun 10 15:00:01.235315 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:01.235282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:01.237333 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:01.237317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fd48d9b75-5h8jc_2b65a7f8-2fcf-4f98-a051-0e1936f86e22/registry/0.log" Jun 10 15:00:01.839971 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:01.839923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8d6r2_346f4452-02c4-46f3-b06a-51dbf5c43d27/node-ca/0.log" Jun 10 15:00:02.252547 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:02.252451 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" podUID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerName="registry" containerID="cri-o://c7fc19fb2a52be19a5998d2160dc98356890df1e9daa2c8ac7b733b38dd97c26" gracePeriod=30 Jun 10 15:00:02.437012 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:02.436981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6m96_6c550c2e-8fbf-4e76-92e2-541218712a72/serve-healthcheck-canary/0.log" Jun 10 15:00:04.248764 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.248732 2578 generic.go:356] "Generic (PLEG): container finished" podID="2b65a7f8-2fcf-4f98-a051-0e1936f86e22" containerID="c7fc19fb2a52be19a5998d2160dc98356890df1e9daa2c8ac7b733b38dd97c26" exitCode=0 Jun 10 15:00:04.249207 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.248800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" event={"ID":"2b65a7f8-2fcf-4f98-a051-0e1936f86e22","Type":"ContainerDied","Data":"c7fc19fb2a52be19a5998d2160dc98356890df1e9daa2c8ac7b733b38dd97c26"} Jun 10 15:00:04.249207 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.248884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" event={"ID":"2b65a7f8-2fcf-4f98-a051-0e1936f86e22","Type":"ContainerStarted","Data":"a2cd5cb306db4485eefaa1a622e9650f316cfcb0d4ac35d9ef3c320aceb8f71f"} Jun 10 15:00:04.249207 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.249072 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 15:00:04.673891 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.673856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:04.676075 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.676046 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9b156d4-c68a-475d-8e98-361a976522ce-metrics-tls\") pod \"dns-default-9ffw9\" (UID: \"a9b156d4-c68a-475d-8e98-361a976522ce\") " pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:04.839312 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.839285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lpmmf\"" Jun 10 15:00:04.847566 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:04.847535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:05.034400 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:05.034363 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ffw9"] Jun 10 15:00:05.037368 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:00:05.037342 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b156d4_c68a_475d_8e98_361a976522ce.slice/crio-e7216045d6c88ff3b50eefaa4460623d690940f9896648d74d925a174cf3107d WatchSource:0}: Error finding container e7216045d6c88ff3b50eefaa4460623d690940f9896648d74d925a174cf3107d: Status 404 returned error can't find the container with id e7216045d6c88ff3b50eefaa4460623d690940f9896648d74d925a174cf3107d Jun 10 15:00:05.254669 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:05.254587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ffw9" event={"ID":"a9b156d4-c68a-475d-8e98-361a976522ce","Type":"ContainerStarted","Data":"e7216045d6c88ff3b50eefaa4460623d690940f9896648d74d925a174cf3107d"} Jun 10 15:00:08.268412 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:08.268375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ffw9" event={"ID":"a9b156d4-c68a-475d-8e98-361a976522ce","Type":"ContainerStarted","Data":"18ed4420c74204d07208bd8b81d84713bffa8420e770c8360ada37c258f5d315"} Jun 10 15:00:08.268794 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:08.268429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ffw9" event={"ID":"a9b156d4-c68a-475d-8e98-361a976522ce","Type":"ContainerStarted","Data":"3f6d1dfee03d082836b9498faea833ab8948a9a12d54e3e9d384d8a962f923b9"} Jun 10 15:00:08.268794 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:08.268490 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:08.293100 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:08.293044 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9ffw9" podStartSLOduration=252.054263147 podStartE2EDuration="4m14.293028233s" totalImagesPullingTime="2.238765086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:00:08.290890039 +0000 UTC m=+288.408449764" watchObservedRunningTime="2026-06-10 15:00:08.293028233 +0000 UTC m=+288.410587958" Jun 10 15:00:18.274407 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:18.274376 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9ffw9" Jun 10 15:00:20.248625 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:20.248602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:00:20.249040 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:20.248644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:00:20.255766 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:20.255747 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 15:00:24.033550 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.033511 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8596f8dc9d-zc4fh" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" containerID="cri-o://bf00b244f73f03051259e293dbfcf5cf811a0856ead6e396d0b31e103cddeb1f" gracePeriod=15 Jun 10 15:00:24.328643 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.328613 2578 generic.go:356] "Generic (PLEG): container finished" podID="35d66299-0660-4a9d-8fe7-81932a77383a" containerID="bf00b244f73f03051259e293dbfcf5cf811a0856ead6e396d0b31e103cddeb1f" exitCode=0 Jun 10 15:00:24.328808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.328684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596f8dc9d-zc4fh" event={"ID":"35d66299-0660-4a9d-8fe7-81932a77383a","Type":"ContainerDied","Data":"bf00b244f73f03051259e293dbfcf5cf811a0856ead6e396d0b31e103cddeb1f"} Jun 10 15:00:24.328808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.328740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8596f8dc9d-zc4fh" event={"ID":"35d66299-0660-4a9d-8fe7-81932a77383a","Type":"ContainerDied","Data":"6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee"} Jun 10 15:00:24.328808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.328760 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c747ec2803db033224bbab39b4d22a1d0d193413c917b76e413d4d76b6953ee" Jun 10 15:00:24.343400 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.343370 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 15:00:24.440922 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.440896 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.440933 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4696\" (UniqueName: \"kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.440985 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441083 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config\") pod \"35d66299-0660-4a9d-8fe7-81932a77383a\" (UID: \"35d66299-0660-4a9d-8fe7-81932a77383a\") " Jun 10 15:00:24.441396 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441367 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca" (OuterVolumeSpecName: "service-ca") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:24.441514 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441447 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:24.441586 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.441551 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config" (OuterVolumeSpecName: "console-config") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:24.443372 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.443344 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696" (OuterVolumeSpecName: "kube-api-access-j4696") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "kube-api-access-j4696". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:00:24.443372 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.443349 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:24.443505 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.443371 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35d66299-0660-4a9d-8fe7-81932a77383a" (UID: "35d66299-0660-4a9d-8fe7-81932a77383a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:24.542279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542243 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-oauth-serving-cert\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:24.542279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542270 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-console-config\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:24.542279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542279 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35d66299-0660-4a9d-8fe7-81932a77383a-service-ca\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:24.542279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542286 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4696\" (UniqueName: \"kubernetes.io/projected/35d66299-0660-4a9d-8fe7-81932a77383a-kube-api-access-j4696\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:24.542523 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542295 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-serving-cert\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:24.542523 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:24.542303 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35d66299-0660-4a9d-8fe7-81932a77383a-console-oauth-config\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:25.258716 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:25.258690 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fd48d9b75-5h8jc" Jun 10 15:00:25.332455 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:25.332425 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8596f8dc9d-zc4fh" Jun 10 15:00:25.383480 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:25.383445 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 15:00:25.406936 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:25.406901 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8596f8dc9d-zc4fh"] Jun 10 15:00:26.279956 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.279923 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:26.280346 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280218 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="alertmanager" containerID="cri-o://c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" gracePeriod=120 Jun 10 15:00:26.280346 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280319 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="prom-label-proxy" containerID="cri-o://05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" gracePeriod=120 Jun 10 15:00:26.280468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280345 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy" containerID="cri-o://2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" gracePeriod=120 Jun 10 15:00:26.280468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280343 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-web" containerID="cri-o://81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" gracePeriod=120 Jun 10 15:00:26.280468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280366 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="config-reloader" containerID="cri-o://ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" gracePeriod=120 Jun 10 15:00:26.280589 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.280294 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-metric" containerID="cri-o://ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" gracePeriod=120 Jun 10 15:00:26.296689 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:26.296666 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" path="/var/lib/kubelet/pods/35d66299-0660-4a9d-8fe7-81932a77383a/volumes" Jun 10 15:00:27.344827 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344802 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" exitCode=0 Jun 10 15:00:27.344827 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344823 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" exitCode=0 Jun 10 15:00:27.344827 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344829 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" exitCode=0 Jun 10 15:00:27.345176 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344835 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" exitCode=0 Jun 10 15:00:27.345176 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344872 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6"} Jun 10 15:00:27.345176 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.344933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21"} Jun 10 15:00:27.345359 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.345345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78"} Jun 10 15:00:27.345393 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.345378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f"} Jun 10 15:00:27.523813 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.523782 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:27.565602 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565573 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qszrz\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.565793 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565622 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.565793 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565653 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.565793 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565760 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.565793 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565792 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566038 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565812 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566038 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565838 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566038 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.565935 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566038 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566023 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566231 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566064 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566231 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566115 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566231 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566144 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566231 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566184 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db\") pod \"c8ffd665-7297-457d-8829-61805b6ba436\" (UID: \"c8ffd665-7297-457d-8829-61805b6ba436\") " Jun 10 15:00:27.566231 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566202 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:27.566464 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566399 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.567106 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.566908 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:00:27.567106 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.567075 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:27.568871 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.568844 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.568997 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.568982 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:00:27.569056 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.569013 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.569056 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.569043 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out" (OuterVolumeSpecName: "config-out") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:00:27.569165 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.569143 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz" (OuterVolumeSpecName: "kube-api-access-qszrz") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "kube-api-access-qszrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:00:27.570290 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.570264 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.570565 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.570542 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume" (OuterVolumeSpecName: "config-volume") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.570673 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.570645 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.572854 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.572828 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.579278 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.579255 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config" (OuterVolumeSpecName: "web-config") pod "c8ffd665-7297-457d-8829-61805b6ba436" (UID: "c8ffd665-7297-457d-8829-61805b6ba436"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667112 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-alertmanager-main-db\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667146 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qszrz\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-kube-api-access-qszrz\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667161 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ffd665-7297-457d-8829-61805b6ba436-metrics-client-ca\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667174 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667188 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ffd665-7297-457d-8829-61805b6ba436-tls-assets\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667200 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-main-tls\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667213 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667227 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-cluster-tls-config\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667239 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667252 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-config-volume\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667265 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ffd665-7297-457d-8829-61805b6ba436-config-out\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.667594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.667276 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ffd665-7297-457d-8829-61805b6ba436-web-config\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:00:27.830477 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830447 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8567985cdf-kj4t2"] Jun 10 15:00:27.830698 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830687 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-web" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830701 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-web" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830712 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="alertmanager" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830717 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="alertmanager" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830724 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="config-reloader" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830728 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="config-reloader" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830735 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-metric" Jun 10 15:00:27.830742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830740 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-metric" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830748 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830753 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830760 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830765 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830771 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="prom-label-proxy" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830776 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="prom-label-proxy" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830784 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="init-config-reloader" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830789 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="init-config-reloader" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830827 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-web" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830833 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d66299-0660-4a9d-8fe7-81932a77383a" containerName="console" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830840 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="alertmanager" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830844 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830850 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="kube-rbac-proxy-metric" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830857 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="config-reloader" Jun 10 15:00:27.830940 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.830863 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ffd665-7297-457d-8829-61805b6ba436" containerName="prom-label-proxy" Jun 10 15:00:27.833265 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.833245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.841353 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.841332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 15:00:27.842096 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.842081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 15:00:27.842351 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.842338 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 15:00:27.842674 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.842661 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 15:00:27.842883 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.842871 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6252z\"" Jun 10 15:00:27.842917 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.842878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 15:00:27.852302 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.852272 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8567985cdf-kj4t2"] Jun 10 15:00:27.854131 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.854104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 15:00:27.868781 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.868754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jn2\" (UniqueName: \"kubernetes.io/projected/baf5b2f3-12a5-4b92-8d94-080595656f08-kube-api-access-q4jn2\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.868906 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.868794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-console-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.868906 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.868844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-oauth-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.869033 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.868892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-trusted-ca-bundle\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.869033 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.869010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.869132 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.869042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-oauth-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.869132 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.869079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-service-ca\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.969863 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jn2\" (UniqueName: \"kubernetes.io/projected/baf5b2f3-12a5-4b92-8d94-080595656f08-kube-api-access-q4jn2\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.969863 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-console-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.969863 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-oauth-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970167 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-trusted-ca-bundle\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970167 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970167 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.969967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-oauth-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970167 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.970141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-service-ca\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970578 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.970555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-console-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970671 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.970654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-oauth-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.970721 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.970706 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-service-ca\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.971237 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.971215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baf5b2f3-12a5-4b92-8d94-080595656f08-trusted-ca-bundle\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.972489 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.972460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-oauth-config\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.972570 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.972464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baf5b2f3-12a5-4b92-8d94-080595656f08-console-serving-cert\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:27.989600 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:27.989580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jn2\" (UniqueName: \"kubernetes.io/projected/baf5b2f3-12a5-4b92-8d94-080595656f08-kube-api-access-q4jn2\") pod \"console-8567985cdf-kj4t2\" (UID: \"baf5b2f3-12a5-4b92-8d94-080595656f08\") " pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:28.141848 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.141808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:28.297794 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.297772 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8567985cdf-kj4t2"] Jun 10 15:00:28.298212 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:00:28.298190 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf5b2f3_12a5_4b92_8d94_080595656f08.slice/crio-b5bf055bc8fd27c141a6e484a3dc1d410b14f02ec9e08de78b95fc1f5b6f3913 WatchSource:0}: Error finding container b5bf055bc8fd27c141a6e484a3dc1d410b14f02ec9e08de78b95fc1f5b6f3913: Status 404 returned error can't find the container with id b5bf055bc8fd27c141a6e484a3dc1d410b14f02ec9e08de78b95fc1f5b6f3913 Jun 10 15:00:28.353334 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353310 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" exitCode=0 Jun 10 15:00:28.353334 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353332 2578 generic.go:356] "Generic (PLEG): container finished" podID="c8ffd665-7297-457d-8829-61805b6ba436" containerID="81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" exitCode=0 Jun 10 15:00:28.353735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205"} Jun 10 15:00:28.353735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353423 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.353735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03"} Jun 10 15:00:28.353735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353520 2578 scope.go:117] "RemoveContainer" containerID="05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" Jun 10 15:00:28.353735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.353537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ffd665-7297-457d-8829-61805b6ba436","Type":"ContainerDied","Data":"285f2718d31e14c155100b961273da7d9181296d2596b0d55823a09ffc727867"} Jun 10 15:00:28.355268 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.355246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8567985cdf-kj4t2" event={"ID":"baf5b2f3-12a5-4b92-8d94-080595656f08","Type":"ContainerStarted","Data":"d6810cc2d405aba447e5da2341b1ce964cd7553be7b91b09030eeb557643dcee"} Jun 10 15:00:28.355376 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.355287 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8567985cdf-kj4t2" event={"ID":"baf5b2f3-12a5-4b92-8d94-080595656f08","Type":"ContainerStarted","Data":"b5bf055bc8fd27c141a6e484a3dc1d410b14f02ec9e08de78b95fc1f5b6f3913"} Jun 10 15:00:28.360998 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.360978 2578 scope.go:117] "RemoveContainer" containerID="ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" Jun 10 15:00:28.368314 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.368295 2578 scope.go:117] "RemoveContainer" containerID="2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" Jun 10 15:00:28.375814 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.375793 2578 scope.go:117] "RemoveContainer" containerID="81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" Jun 10 15:00:28.384065 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.384046 2578 scope.go:117] "RemoveContainer" containerID="ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" Jun 10 15:00:28.391126 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.391107 2578 scope.go:117] "RemoveContainer" containerID="c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" Jun 10 15:00:28.399026 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.398787 2578 scope.go:117] "RemoveContainer" containerID="ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351" Jun 10 15:00:28.406105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.406085 2578 scope.go:117] "RemoveContainer" containerID="05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" Jun 10 15:00:28.406405 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.406381 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6\": container with ID starting with 05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6 not found: ID does not exist" containerID="05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" Jun 10 15:00:28.406485 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.406416 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6"} err="failed to get container status \"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6\": rpc error: code = NotFound desc = could not find container \"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6\": container with ID starting with 05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6 not found: ID does not exist" Jun 10 15:00:28.406485 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.406438 2578 scope.go:117] "RemoveContainer" containerID="ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" Jun 10 15:00:28.406713 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.406695 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205\": container with ID starting with ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205 not found: ID does not exist" containerID="ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" Jun 10 15:00:28.406765 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.406719 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205"} err="failed to get container status \"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205\": rpc error: code = NotFound desc = could not find container \"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205\": container with ID starting with ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205 not found: ID does not exist" Jun 10 15:00:28.406765 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.406735 2578 scope.go:117] "RemoveContainer" containerID="2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" Jun 10 15:00:28.407054 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.407031 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21\": container with ID starting with 2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21 not found: ID does not exist" containerID="2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" Jun 10 15:00:28.407166 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407056 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21"} err="failed to get container status \"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21\": rpc error: code = NotFound desc = could not find container \"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21\": container with ID starting with 2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21 not found: ID does not exist" Jun 10 15:00:28.407166 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407071 2578 scope.go:117] "RemoveContainer" containerID="81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" Jun 10 15:00:28.407291 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.407278 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03\": container with ID starting with 81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03 not found: ID does not exist" containerID="81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" Jun 10 15:00:28.407346 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407293 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03"} err="failed to get container status \"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03\": rpc error: code = NotFound desc = could not find container \"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03\": container with ID starting with 81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03 not found: ID does not exist" Jun 10 15:00:28.407346 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407306 2578 scope.go:117] "RemoveContainer" containerID="ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" Jun 10 15:00:28.407524 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.407507 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78\": container with ID starting with ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78 not found: ID does not exist" containerID="ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" Jun 10 15:00:28.407578 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407528 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78"} err="failed to get container status \"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78\": rpc error: code = NotFound desc = could not find container \"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78\": container with ID starting with ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78 not found: ID does not exist" Jun 10 15:00:28.407578 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407550 2578 scope.go:117] "RemoveContainer" containerID="c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" Jun 10 15:00:28.407791 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.407755 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f\": container with ID starting with c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f not found: ID does not exist" containerID="c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" Jun 10 15:00:28.407904 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407787 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f"} err="failed to get container status \"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f\": rpc error: code = NotFound desc = could not find container \"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f\": container with ID starting with c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f not found: ID does not exist" Jun 10 15:00:28.407904 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.407806 2578 scope.go:117] "RemoveContainer" containerID="ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351" Jun 10 15:00:28.408094 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:00:28.408072 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351\": container with ID starting with ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351 not found: ID does not exist" containerID="ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351" Jun 10 15:00:28.408149 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408100 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351"} err="failed to get container status \"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351\": rpc error: code = NotFound desc = could not find container \"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351\": container with ID starting with ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351 not found: ID does not exist" Jun 10 15:00:28.408149 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408119 2578 scope.go:117] "RemoveContainer" containerID="05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6" Jun 10 15:00:28.408334 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408314 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6"} err="failed to get container status \"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6\": rpc error: code = NotFound desc = could not find container \"05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6\": container with ID starting with 05903d1c5cc0814395aae289a8be13319b4ceee1738749c953e52d0d632730a6 not found: ID does not exist" Jun 10 15:00:28.408396 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408334 2578 scope.go:117] "RemoveContainer" containerID="ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205" Jun 10 15:00:28.408546 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408525 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205"} err="failed to get container status \"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205\": rpc error: code = NotFound desc = could not find container \"ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205\": container with ID starting with ac0042149d34e3299233e609c28a4d1597d1fb5ae07a015627d6ede0f0abb205 not found: ID does not exist" Jun 10 15:00:28.408628 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408547 2578 scope.go:117] "RemoveContainer" containerID="2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21" Jun 10 15:00:28.408919 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408883 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21"} err="failed to get container status \"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21\": rpc error: code = NotFound desc = could not find container \"2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21\": container with ID starting with 2dd010d7d9cfaeb7119105779e22065950e49f85587ac45d94e0ab43be42ce21 not found: ID does not exist" Jun 10 15:00:28.408919 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.408917 2578 scope.go:117] "RemoveContainer" containerID="81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03" Jun 10 15:00:28.409174 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409157 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03"} err="failed to get container status \"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03\": rpc error: code = NotFound desc = could not find container \"81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03\": container with ID starting with 81244065d42aeea8886f5422aacbe160ccd9a585035a0c9d49482ef9b7e2bb03 not found: ID does not exist" Jun 10 15:00:28.409234 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409174 2578 scope.go:117] "RemoveContainer" containerID="ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78" Jun 10 15:00:28.409418 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409399 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78"} err="failed to get container status \"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78\": rpc error: code = NotFound desc = could not find container \"ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78\": container with ID starting with ac154cfe8057d74e1fbf0404eb93ae7964c7fe3ae1136e15fe64e8406a965a78 not found: ID does not exist" Jun 10 15:00:28.409492 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409419 2578 scope.go:117] "RemoveContainer" containerID="c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f" Jun 10 15:00:28.409635 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409617 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f"} err="failed to get container status \"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f\": rpc error: code = NotFound desc = could not find container \"c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f\": container with ID starting with c59df69a08764653320cfbedd487a4ec37a80b475bb5d95c63a497aff81c225f not found: ID does not exist" Jun 10 15:00:28.409700 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409635 2578 scope.go:117] "RemoveContainer" containerID="ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351" Jun 10 15:00:28.409856 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.409833 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351"} err="failed to get container status \"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351\": rpc error: code = NotFound desc = could not find container \"ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351\": container with ID starting with ea1673853699756b1bbca267b12e90181c77bbcdec538e704eb0bd6ee1b07351 not found: ID does not exist" Jun 10 15:00:28.526359 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.526259 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8567985cdf-kj4t2" podStartSLOduration=1.526242077 podStartE2EDuration="1.526242077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:00:28.526010767 +0000 UTC m=+308.643570492" watchObservedRunningTime="2026-06-10 15:00:28.526242077 +0000 UTC m=+308.643801801" Jun 10 15:00:28.554232 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.554188 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:28.563428 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.563392 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:28.624787 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.624757 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:28.628577 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.628556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.635462 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.635435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 15:00:28.635624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.635439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 15:00:28.635624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.635495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 15:00:28.635624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.635499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 15:00:28.635801 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.635785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 15:00:28.636262 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.636246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mzbg8\"" Jun 10 15:00:28.636314 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.636260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 15:00:28.636492 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.636478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 15:00:28.636602 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.636587 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 15:00:28.642471 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.642449 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 15:00:28.655871 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.655845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:28.675478 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675624 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-out\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675895 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-web-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675895 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675895 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.675895 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.675811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjj6\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-kube-api-access-bbjj6\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776226 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjj6\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-kube-api-access-bbjj6\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-out\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-web-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.776817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.776581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.777586 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.777438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.777586 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.777537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.778139 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.778082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7d82ef8-65ee-4af9-aebe-c31ddecada29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.779442 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.779412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.779840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-out\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.779918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780252 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780290 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.780981 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.780936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7d82ef8-65ee-4af9-aebe-c31ddecada29-web-config\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.786959 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.786922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjj6\" (UniqueName: \"kubernetes.io/projected/f7d82ef8-65ee-4af9-aebe-c31ddecada29-kube-api-access-bbjj6\") pod \"alertmanager-main-0\" (UID: \"f7d82ef8-65ee-4af9-aebe-c31ddecada29\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:28.937744 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:28.937702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:00:29.101610 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:29.101582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:00:29.104027 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:00:29.104003 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d82ef8_65ee_4af9_aebe_c31ddecada29.slice/crio-511c3fde6b3d0a59cb51ef861d23ea3239c12590d74d13aa454a3609c5575b07 WatchSource:0}: Error finding container 511c3fde6b3d0a59cb51ef861d23ea3239c12590d74d13aa454a3609c5575b07: Status 404 returned error can't find the container with id 511c3fde6b3d0a59cb51ef861d23ea3239c12590d74d13aa454a3609c5575b07 Jun 10 15:00:29.366160 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:29.366067 2578 generic.go:356] "Generic (PLEG): container finished" podID="f7d82ef8-65ee-4af9-aebe-c31ddecada29" containerID="4ddc3a316f7613d43466f17091ec1a3bed60a2b2e1b751c125f3dabe67117119" exitCode=0 Jun 10 15:00:29.366584 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:29.366151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerDied","Data":"4ddc3a316f7613d43466f17091ec1a3bed60a2b2e1b751c125f3dabe67117119"} Jun 10 15:00:29.366584 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:29.366270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"511c3fde6b3d0a59cb51ef861d23ea3239c12590d74d13aa454a3609c5575b07"} Jun 10 15:00:30.296803 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.296769 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ffd665-7297-457d-8829-61805b6ba436" path="/var/lib/kubelet/pods/c8ffd665-7297-457d-8829-61805b6ba436/volumes" Jun 10 15:00:30.374071 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"63144a562888ba31b93e3f67fa3849b241eaea8fe90c0b56d696dd39fecdbd46"} Jun 10 15:00:30.374444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"5a9ee131684e5034f7405c702441006d0ca72a9499562ee1ce3a6215440c94bb"} Jun 10 15:00:30.374444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"8683f00d6a71a70e6e09b9a8b7da047a88f562c2b31c9bc0a4820e18b101a2f6"} Jun 10 15:00:30.374444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"4008910d003459de9ae065d63a593db5529fb3fa7c1a6d01cb21acc2feccf794"} Jun 10 15:00:30.374444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"72a28f54c155148bfbda88b083ec5add492bd332146c6b8f2e73c79d979ed671"} Jun 10 15:00:30.374444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.374264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7d82ef8-65ee-4af9-aebe-c31ddecada29","Type":"ContainerStarted","Data":"0c8bfbe570f76a19fdaa450b7335070d98f4ef3cd5f2585323d434ce4806269b"} Jun 10 15:00:30.408070 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:30.408008 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.393351992 podStartE2EDuration="2.407984654s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.632662ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:00:30.406632345 +0000 UTC m=+310.524192068" watchObservedRunningTime="2026-06-10 15:00:30.407984654 +0000 UTC m=+310.525544380" Jun 10 15:00:38.142805 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:38.142755 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:38.143255 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:38.142828 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:38.147454 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:38.147432 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:00:38.409727 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:00:38.409651 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8567985cdf-kj4t2" Jun 10 15:02:54.082920 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.082887 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-brh56"] Jun 10 15:02:54.085228 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.085210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.087486 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.087465 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 15:02:54.088358 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.088334 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 15:02:54.088490 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.088343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8x8kt\"" Jun 10 15:02:54.096079 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.096055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-brh56"] Jun 10 15:02:54.193841 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.193807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-bound-sa-token\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.193841 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.193838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v26x\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-kube-api-access-4v26x\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.294593 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.294559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-bound-sa-token\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.294593 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.294589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v26x\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-kube-api-access-4v26x\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.302898 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.302874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-bound-sa-token\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.303061 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.303029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v26x\" (UniqueName: \"kubernetes.io/projected/cf387d62-16b9-4cbb-a1f7-0eeda6238edd-kube-api-access-4v26x\") pod \"cert-manager-59c77684cc-brh56\" (UID: \"cf387d62-16b9-4cbb-a1f7-0eeda6238edd\") " pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.395068 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.394978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-brh56" Jun 10 15:02:54.528643 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.528614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-brh56"] Jun 10 15:02:54.531998 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:02:54.531935 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf387d62_16b9_4cbb_a1f7_0eeda6238edd.slice/crio-38e7d5881ab046b06a47f3fc8397d8883dac96d569a22ade2531d555179f8499 WatchSource:0}: Error finding container 38e7d5881ab046b06a47f3fc8397d8883dac96d569a22ade2531d555179f8499: Status 404 returned error can't find the container with id 38e7d5881ab046b06a47f3fc8397d8883dac96d569a22ade2531d555179f8499 Jun 10 15:02:54.533993 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.533974 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:02:54.907419 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:54.907384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-brh56" event={"ID":"cf387d62-16b9-4cbb-a1f7-0eeda6238edd","Type":"ContainerStarted","Data":"38e7d5881ab046b06a47f3fc8397d8883dac96d569a22ade2531d555179f8499"} Jun 10 15:02:57.921111 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:57.921077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-brh56" event={"ID":"cf387d62-16b9-4cbb-a1f7-0eeda6238edd","Type":"ContainerStarted","Data":"02f7cfd4c1c931eb3db1252dfd485aa9e77d061a1fb88d0ef4d075bd466ae7bf"} Jun 10 15:02:57.936941 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:02:57.936890 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-brh56" podStartSLOduration=1.198333673 podStartE2EDuration="3.936875328s" totalImagesPullingTime="2.738541655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:57.935858628 +0000 UTC m=+458.053418346" watchObservedRunningTime="2026-06-10 15:02:57.936875328 +0000 UTC m=+458.054435051" Jun 10 15:03:01.375980 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.375933 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r"] Jun 10 15:03:01.378159 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.378142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.380757 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.380737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 15:03:01.381652 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.381634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 15:03:01.381753 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.381644 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 15:03:01.381753 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.381663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 15:03:01.381862 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.381768 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fm4p7\"" Jun 10 15:03:01.381862 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.381848 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 15:03:01.390586 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.390567 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r"] Jun 10 15:03:01.454616 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.454583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3291ce80-fe16-4cf3-980c-fba4a5918e5f-manager-config\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.454771 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.454631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jmsw\" (UniqueName: \"kubernetes.io/projected/3291ce80-fe16-4cf3-980c-fba4a5918e5f-kube-api-access-5jmsw\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.454771 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.454681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.454771 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.454699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.556080 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.556038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jmsw\" (UniqueName: \"kubernetes.io/projected/3291ce80-fe16-4cf3-980c-fba4a5918e5f-kube-api-access-5jmsw\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.556244 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.556108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.556244 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.556141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.556244 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.556197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3291ce80-fe16-4cf3-980c-fba4a5918e5f-manager-config\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.556842 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.556815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3291ce80-fe16-4cf3-980c-fba4a5918e5f-manager-config\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.558628 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.558612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.558696 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.558646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3291ce80-fe16-4cf3-980c-fba4a5918e5f-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.565709 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.565685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jmsw\" (UniqueName: \"kubernetes.io/projected/3291ce80-fe16-4cf3-980c-fba4a5918e5f-kube-api-access-5jmsw\") pod \"lws-controller-manager-7776b7cdb6-dsk5r\" (UID: \"3291ce80-fe16-4cf3-980c-fba4a5918e5f\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.687051 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.686940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:01.858023 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.857959 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r"] Jun 10 15:03:01.861797 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:03:01.861766 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3291ce80_fe16_4cf3_980c_fba4a5918e5f.slice/crio-d7dbc0e4b484ae69e0d3a443948cc9fb59684ed60913e4e56cd2e5b147299530 WatchSource:0}: Error finding container d7dbc0e4b484ae69e0d3a443948cc9fb59684ed60913e4e56cd2e5b147299530: Status 404 returned error can't find the container with id d7dbc0e4b484ae69e0d3a443948cc9fb59684ed60913e4e56cd2e5b147299530 Jun 10 15:03:01.938402 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:01.938309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" event={"ID":"3291ce80-fe16-4cf3-980c-fba4a5918e5f","Type":"ContainerStarted","Data":"d7dbc0e4b484ae69e0d3a443948cc9fb59684ed60913e4e56cd2e5b147299530"} Jun 10 15:03:04.952769 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:04.952674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" event={"ID":"3291ce80-fe16-4cf3-980c-fba4a5918e5f","Type":"ContainerStarted","Data":"fbb03026b9eefd4da6af46c05541143a18b6c2acf06df68004d13e71897869b6"} Jun 10 15:03:04.952769 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:04.952742 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:04.976317 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:04.976268 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" podStartSLOduration=1.206788574 podStartE2EDuration="3.97625175s" totalImagesPullingTime="2.769463176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:03:04.974172834 +0000 UTC m=+465.091732559" watchObservedRunningTime="2026-06-10 15:03:04.97625175 +0000 UTC m=+465.093811471" Jun 10 15:03:14.511117 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.511079 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7"] Jun 10 15:03:14.514093 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.514074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.516994 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.516972 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 15:03:14.516994 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.516986 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 15:03:14.517142 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.517126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 15:03:14.517356 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.517340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 15:03:14.519406 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.519384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xnmmp\"" Jun 10 15:03:14.539523 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.539496 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7"] Jun 10 15:03:14.670468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.670432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.670468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.670468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.670684 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.670494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.670684 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.670510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.670684 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.670605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcfb\" (UniqueName: \"kubernetes.io/projected/ac941a5c-cd32-4061-b6b0-6315a3822754-kube-api-access-dmcfb\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.771937 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.771859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.771937 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.771892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.771937 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.771931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcfb\" (UniqueName: \"kubernetes.io/projected/ac941a5c-cd32-4061-b6b0-6315a3822754-kube-api-access-dmcfb\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.772213 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.772027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.772213 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.772157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.772434 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.772408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.774173 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.774149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac941a5c-cd32-4061-b6b0-6315a3822754-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.774419 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.774402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.774497 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.774476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac941a5c-cd32-4061-b6b0-6315a3822754-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.782171 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.782143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcfb\" (UniqueName: \"kubernetes.io/projected/ac941a5c-cd32-4061-b6b0-6315a3822754-kube-api-access-dmcfb\") pod \"opendatahub-operator-controller-manager-b55bf6875-n9xl7\" (UID: \"ac941a5c-cd32-4061-b6b0-6315a3822754\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.824023 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.823985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:14.999267 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:14.999212 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7"] Jun 10 15:03:15.002259 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:03:15.002235 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac941a5c_cd32_4061_b6b0_6315a3822754.slice/crio-2af854ba3917fada3c000b0eecda3ff56ebfdc8bfe039c00de50844ce33d0bfd WatchSource:0}: Error finding container 2af854ba3917fada3c000b0eecda3ff56ebfdc8bfe039c00de50844ce33d0bfd: Status 404 returned error can't find the container with id 2af854ba3917fada3c000b0eecda3ff56ebfdc8bfe039c00de50844ce33d0bfd Jun 10 15:03:15.958805 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:15.958771 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-dsk5r" Jun 10 15:03:15.997344 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:15.997309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" event={"ID":"ac941a5c-cd32-4061-b6b0-6315a3822754","Type":"ContainerStarted","Data":"2af854ba3917fada3c000b0eecda3ff56ebfdc8bfe039c00de50844ce33d0bfd"} Jun 10 15:03:19.011868 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:19.011834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" event={"ID":"ac941a5c-cd32-4061-b6b0-6315a3822754","Type":"ContainerStarted","Data":"5a9cd5fb7a5b188cbde2f3c2f166978136fb7fd4eb0aab2725c72075c78c12fc"} Jun 10 15:03:20.017669 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:20.017634 2578 generic.go:356] "Generic (PLEG): container finished" podID="ac941a5c-cd32-4061-b6b0-6315a3822754" containerID="5a9cd5fb7a5b188cbde2f3c2f166978136fb7fd4eb0aab2725c72075c78c12fc" exitCode=0 Jun 10 15:03:20.018174 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:20.017724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" event={"ID":"ac941a5c-cd32-4061-b6b0-6315a3822754","Type":"ContainerDied","Data":"5a9cd5fb7a5b188cbde2f3c2f166978136fb7fd4eb0aab2725c72075c78c12fc"} Jun 10 15:03:21.023836 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:21.023802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" event={"ID":"ac941a5c-cd32-4061-b6b0-6315a3822754","Type":"ContainerStarted","Data":"2be722c958739c3a227831923bc7017e2596d15a73077b83830d71592f7eb12d"} Jun 10 15:03:21.024251 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:21.023916 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:21.052301 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:21.052253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" podStartSLOduration=2.755637971 podStartE2EDuration="7.052235918s" totalImagesPullingTime="3.326388753s" totalInitContainerRuntime="970.209194ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:03:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:03:21.050065558 +0000 UTC m=+481.167625282" watchObservedRunningTime="2026-06-10 15:03:21.052235918 +0000 UTC m=+481.169795642" Jun 10 15:03:32.030313 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:32.030281 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-n9xl7" Jun 10 15:03:34.252707 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.252679 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz"] Jun 10 15:03:34.270372 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.270335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.274672 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.274649 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 15:03:34.275168 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.275147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 15:03:34.275280 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.275145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 15:03:34.277327 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.277304 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 15:03:34.277482 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.277384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz"] Jun 10 15:03:34.280332 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.280315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4ph6w\"" Jun 10 15:03:34.434823 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.434789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221e64be-b5ae-4646-8377-8c193d733bfd-tmp\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.435003 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.434859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfsh\" (UniqueName: \"kubernetes.io/projected/221e64be-b5ae-4646-8377-8c193d733bfd-kube-api-access-2pfsh\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.435003 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.434916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221e64be-b5ae-4646-8377-8c193d733bfd-tls-certs\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.535866 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.535785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221e64be-b5ae-4646-8377-8c193d733bfd-tmp\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.535866 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.535844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfsh\" (UniqueName: \"kubernetes.io/projected/221e64be-b5ae-4646-8377-8c193d733bfd-kube-api-access-2pfsh\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.536078 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.535875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221e64be-b5ae-4646-8377-8c193d733bfd-tls-certs\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.538156 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.538131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221e64be-b5ae-4646-8377-8c193d733bfd-tmp\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.538311 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.538295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221e64be-b5ae-4646-8377-8c193d733bfd-tls-certs\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.559888 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.559855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfsh\" (UniqueName: \"kubernetes.io/projected/221e64be-b5ae-4646-8377-8c193d733bfd-kube-api-access-2pfsh\") pod \"kube-auth-proxy-668fbbff94-fpcpz\" (UID: \"221e64be-b5ae-4646-8377-8c193d733bfd\") " pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.580428 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.580402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" Jun 10 15:03:34.723487 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:34.723456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz"] Jun 10 15:03:34.725820 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:03:34.725789 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221e64be_b5ae_4646_8377_8c193d733bfd.slice/crio-1a44392cab3c7dff9a4ea19d88e8a1e6eeabdfd594f854c7abacd8dc13ccf29a WatchSource:0}: Error finding container 1a44392cab3c7dff9a4ea19d88e8a1e6eeabdfd594f854c7abacd8dc13ccf29a: Status 404 returned error can't find the container with id 1a44392cab3c7dff9a4ea19d88e8a1e6eeabdfd594f854c7abacd8dc13ccf29a Jun 10 15:03:35.084890 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:35.084851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" event={"ID":"221e64be-b5ae-4646-8377-8c193d733bfd","Type":"ContainerStarted","Data":"1a44392cab3c7dff9a4ea19d88e8a1e6eeabdfd594f854c7abacd8dc13ccf29a"} Jun 10 15:03:39.104805 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:39.104767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" event={"ID":"221e64be-b5ae-4646-8377-8c193d733bfd","Type":"ContainerStarted","Data":"b4028ce1f4b59d98c03d2fda5967fb95025a10d4604df26b8918d5c9322b6971"} Jun 10 15:03:39.123330 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:03:39.123282 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-668fbbff94-fpcpz" podStartSLOduration=1.286157033 podStartE2EDuration="5.123267691s" totalImagesPullingTime="3.837110658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:03:39.121285168 +0000 UTC m=+499.238844903" watchObservedRunningTime="2026-06-10 15:03:39.123267691 +0000 UTC m=+499.240827415" Jun 10 15:05:20.273113 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:20.273086 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:05:20.274510 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:20.274489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:05:23.580545 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.580513 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-klr27"] Jun 10 15:05:23.583651 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.583633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.594031 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.594009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 15:05:23.594119 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.594020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xfff6\"" Jun 10 15:05:23.594987 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.594969 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 15:05:23.595035 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.595025 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 15:05:23.595786 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.595771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 15:05:23.601393 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.601373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-klr27"] Jun 10 15:05:23.669120 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.669089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmtm\" (UniqueName: \"kubernetes.io/projected/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-kube-api-access-zgmtm\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.669263 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.669152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.669263 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.669177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.769555 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.769508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.769678 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.769571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.769678 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.769633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmtm\" (UniqueName: \"kubernetes.io/projected/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-kube-api-access-zgmtm\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.770246 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.770228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.771922 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.771903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.780984 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.780959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmtm\" (UniqueName: \"kubernetes.io/projected/f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5-kube-api-access-zgmtm\") pod \"kuadrant-console-plugin-66b5774985-klr27\" (UID: \"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:23.892734 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:23.892666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" Jun 10 15:05:24.045658 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:24.039871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-klr27"] Jun 10 15:05:24.045658 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:05:24.042231 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6ad5d04_45a5_4193_b00e_a8a1fa4a76e5.slice/crio-29b7f4ad18b2c12bbcd643bcaa3cd71518772484c79ebb0031f45ce9737a1ad5 WatchSource:0}: Error finding container 29b7f4ad18b2c12bbcd643bcaa3cd71518772484c79ebb0031f45ce9737a1ad5: Status 404 returned error can't find the container with id 29b7f4ad18b2c12bbcd643bcaa3cd71518772484c79ebb0031f45ce9737a1ad5 Jun 10 15:05:24.533589 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:24.533544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" event={"ID":"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5","Type":"ContainerStarted","Data":"29b7f4ad18b2c12bbcd643bcaa3cd71518772484c79ebb0031f45ce9737a1ad5"} Jun 10 15:05:49.661090 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:49.661001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" event={"ID":"f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5","Type":"ContainerStarted","Data":"2a95fe0b4c3a67bcae8908ec39511446e36851a6a944470a67605a49d609e407"} Jun 10 15:05:49.688210 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:05:49.688157 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-klr27" podStartSLOduration=1.393517932 podStartE2EDuration="26.688141314s" totalImagesPullingTime="25.294623382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:49.687295973 +0000 UTC m=+629.804855698" watchObservedRunningTime="2026-06-10 15:05:49.688141314 +0000 UTC m=+629.805701037" Jun 10 15:06:10.622007 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.621970 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:10.624184 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.624164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.626468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.626444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 15:06:10.637121 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.637092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:10.687063 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.687032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppfb\" (UniqueName: \"kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.687063 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.687065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.698089 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.698064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:10.787966 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.787914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wppfb\" (UniqueName: \"kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.787966 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.787968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.788610 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.788592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.801929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.801906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppfb\" (UniqueName: \"kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb\") pod \"limitador-limitador-64c94fd64f-zzpdn\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:10.934791 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:10.934701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:11.070645 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.070620 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:11.072731 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:06:11.072697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf911d009_b1d3_4e52_90a7_faf4621ce6fb.slice/crio-aa6724512ceef528a2ed1bb8987091da7f8444a3f6f30ce947e8afab0385ff82 WatchSource:0}: Error finding container aa6724512ceef528a2ed1bb8987091da7f8444a3f6f30ce947e8afab0385ff82: Status 404 returned error can't find the container with id aa6724512ceef528a2ed1bb8987091da7f8444a3f6f30ce947e8afab0385ff82 Jun 10 15:06:11.435025 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.434992 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:11.442361 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.442333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:11.446632 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.446605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-69wjd\"" Jun 10 15:06:11.446894 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.446874 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:11.494637 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.494609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brx8b\" (UniqueName: \"kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b\") pod \"authorino-58cd955675-lbm7p\" (UID: \"51690a98-9795-4195-ae19-251de9f08adf\") " pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:11.595496 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.595455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brx8b\" (UniqueName: \"kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b\") pod \"authorino-58cd955675-lbm7p\" (UID: \"51690a98-9795-4195-ae19-251de9f08adf\") " pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:11.606775 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.606745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brx8b\" (UniqueName: \"kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b\") pod \"authorino-58cd955675-lbm7p\" (UID: \"51690a98-9795-4195-ae19-251de9f08adf\") " pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:11.662049 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.662019 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:06:11.664035 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.664013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:06:11.679086 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.679060 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:06:11.697132 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.696987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrcjb\" (UniqueName: \"kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb\") pod \"authorino-75d556bd77-nd6zn\" (UID: \"fa176ce0-15df-4819-9ada-23e34abc783f\") " pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:06:11.753004 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.752653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:11.757549 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.757515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" event={"ID":"f911d009-b1d3-4e52-90a7-faf4621ce6fb","Type":"ContainerStarted","Data":"aa6724512ceef528a2ed1bb8987091da7f8444a3f6f30ce947e8afab0385ff82"} Jun 10 15:06:11.798761 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.798368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrcjb\" (UniqueName: \"kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb\") pod \"authorino-75d556bd77-nd6zn\" (UID: \"fa176ce0-15df-4819-9ada-23e34abc783f\") " pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:06:11.808127 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.808068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrcjb\" (UniqueName: \"kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb\") pod \"authorino-75d556bd77-nd6zn\" (UID: \"fa176ce0-15df-4819-9ada-23e34abc783f\") " pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:06:11.928534 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.928496 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:11.932693 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:06:11.932648 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51690a98_9795_4195_ae19_251de9f08adf.slice/crio-8160b61cbed5545efbd79321ff49fc600875e24efbc3714505203ead71ad2f2e WatchSource:0}: Error finding container 8160b61cbed5545efbd79321ff49fc600875e24efbc3714505203ead71ad2f2e: Status 404 returned error can't find the container with id 8160b61cbed5545efbd79321ff49fc600875e24efbc3714505203ead71ad2f2e Jun 10 15:06:11.974703 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:11.974630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:06:12.137461 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:12.137234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:06:12.139887 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:06:12.139855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa176ce0_15df_4819_9ada_23e34abc783f.slice/crio-9110839ab385ff6bb536fa62b6ddd32136ca6f19ae558da896dbeec47648262c WatchSource:0}: Error finding container 9110839ab385ff6bb536fa62b6ddd32136ca6f19ae558da896dbeec47648262c: Status 404 returned error can't find the container with id 9110839ab385ff6bb536fa62b6ddd32136ca6f19ae558da896dbeec47648262c Jun 10 15:06:12.764257 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:12.764198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lbm7p" event={"ID":"51690a98-9795-4195-ae19-251de9f08adf","Type":"ContainerStarted","Data":"8160b61cbed5545efbd79321ff49fc600875e24efbc3714505203ead71ad2f2e"} Jun 10 15:06:12.765761 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:12.765731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6zn" event={"ID":"fa176ce0-15df-4819-9ada-23e34abc783f","Type":"ContainerStarted","Data":"9110839ab385ff6bb536fa62b6ddd32136ca6f19ae558da896dbeec47648262c"} Jun 10 15:06:16.793283 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.793246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" event={"ID":"f911d009-b1d3-4e52-90a7-faf4621ce6fb","Type":"ContainerStarted","Data":"93454fd726d8d3bd27c13d050bc06754b27fd6830d64e00bb9cc4ecf64712166"} Jun 10 15:06:16.793753 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.793344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:16.794666 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.794644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lbm7p" event={"ID":"51690a98-9795-4195-ae19-251de9f08adf","Type":"ContainerStarted","Data":"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167"} Jun 10 15:06:16.795958 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.795918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6zn" event={"ID":"fa176ce0-15df-4819-9ada-23e34abc783f","Type":"ContainerStarted","Data":"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca"} Jun 10 15:06:16.810251 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.810206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" podStartSLOduration=1.919812734 podStartE2EDuration="6.810192914s" totalImagesPullingTime="4.89038018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:16.810041155 +0000 UTC m=+656.927600880" watchObservedRunningTime="2026-06-10 15:06:16.810192914 +0000 UTC m=+656.927752641" Jun 10 15:06:16.825429 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.825388 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lbm7p" podStartSLOduration=1.731762835 podStartE2EDuration="5.825376821s" totalImagesPullingTime="4.093613986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:16.824025027 +0000 UTC m=+656.941584747" watchObservedRunningTime="2026-06-10 15:06:16.825376821 +0000 UTC m=+656.942936544" Jun 10 15:06:16.840269 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.840218 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nd6zn" podStartSLOduration=1.942925742 podStartE2EDuration="5.840205082s" totalImagesPullingTime="3.89727934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:16.839161387 +0000 UTC m=+656.956721114" watchObservedRunningTime="2026-06-10 15:06:16.840205082 +0000 UTC m=+656.957764806" Jun 10 15:06:16.868601 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:16.868572 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:18.804420 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:18.804375 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lbm7p" podUID="51690a98-9795-4195-ae19-251de9f08adf" containerName="authorino" containerID="cri-o://967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167" gracePeriod=30 Jun 10 15:06:19.043203 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.043176 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:19.167526 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.167491 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brx8b\" (UniqueName: \"kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b\") pod \"51690a98-9795-4195-ae19-251de9f08adf\" (UID: \"51690a98-9795-4195-ae19-251de9f08adf\") " Jun 10 15:06:19.169698 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.169652 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b" (OuterVolumeSpecName: "kube-api-access-brx8b") pod "51690a98-9795-4195-ae19-251de9f08adf" (UID: "51690a98-9795-4195-ae19-251de9f08adf"). InnerVolumeSpecName "kube-api-access-brx8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:06:19.268842 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.268804 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brx8b\" (UniqueName: \"kubernetes.io/projected/51690a98-9795-4195-ae19-251de9f08adf-kube-api-access-brx8b\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:06:19.809610 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.809574 2578 generic.go:356] "Generic (PLEG): container finished" podID="51690a98-9795-4195-ae19-251de9f08adf" containerID="967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167" exitCode=0 Jun 10 15:06:19.810032 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.809616 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lbm7p" Jun 10 15:06:19.810032 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.809660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lbm7p" event={"ID":"51690a98-9795-4195-ae19-251de9f08adf","Type":"ContainerDied","Data":"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167"} Jun 10 15:06:19.810032 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.809699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lbm7p" event={"ID":"51690a98-9795-4195-ae19-251de9f08adf","Type":"ContainerDied","Data":"8160b61cbed5545efbd79321ff49fc600875e24efbc3714505203ead71ad2f2e"} Jun 10 15:06:19.810032 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.809717 2578 scope.go:117] "RemoveContainer" containerID="967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167" Jun 10 15:06:19.817939 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.817922 2578 scope.go:117] "RemoveContainer" containerID="967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167" Jun 10 15:06:19.818256 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:06:19.818229 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167\": container with ID starting with 967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167 not found: ID does not exist" containerID="967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167" Jun 10 15:06:19.818358 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.818267 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167"} err="failed to get container status \"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167\": rpc error: code = NotFound desc = could not find container \"967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167\": container with ID starting with 967b58b2d77e5745968f7976baaa3bc5062a1e20b07460faf00b509f81a07167 not found: ID does not exist" Jun 10 15:06:19.832202 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.832175 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:19.837041 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:19.837019 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lbm7p"] Jun 10 15:06:20.289025 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:20.288993 2578 scope.go:117] "RemoveContainer" containerID="bf00b244f73f03051259e293dbfcf5cf811a0856ead6e396d0b31e103cddeb1f" Jun 10 15:06:20.298735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:20.298711 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51690a98-9795-4195-ae19-251de9f08adf" path="/var/lib/kubelet/pods/51690a98-9795-4195-ae19-251de9f08adf/volumes" Jun 10 15:06:25.395318 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.395281 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:25.395730 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.395468 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" podUID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" containerName="limitador" containerID="cri-o://93454fd726d8d3bd27c13d050bc06754b27fd6830d64e00bb9cc4ecf64712166" gracePeriod=30 Jun 10 15:06:25.397757 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.397736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:25.836909 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.836871 2578 generic.go:356] "Generic (PLEG): container finished" podID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" containerID="93454fd726d8d3bd27c13d050bc06754b27fd6830d64e00bb9cc4ecf64712166" exitCode=0 Jun 10 15:06:25.837069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.836929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" event={"ID":"f911d009-b1d3-4e52-90a7-faf4621ce6fb","Type":"ContainerDied","Data":"93454fd726d8d3bd27c13d050bc06754b27fd6830d64e00bb9cc4ecf64712166"} Jun 10 15:06:25.936569 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:25.936542 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:26.028826 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.028747 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file\") pod \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " Jun 10 15:06:26.028826 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.028789 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wppfb\" (UniqueName: \"kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb\") pod \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\" (UID: \"f911d009-b1d3-4e52-90a7-faf4621ce6fb\") " Jun 10 15:06:26.029220 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.029192 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file" (OuterVolumeSpecName: "config-file") pod "f911d009-b1d3-4e52-90a7-faf4621ce6fb" (UID: "f911d009-b1d3-4e52-90a7-faf4621ce6fb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:06:26.030900 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.030877 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb" (OuterVolumeSpecName: "kube-api-access-wppfb") pod "f911d009-b1d3-4e52-90a7-faf4621ce6fb" (UID: "f911d009-b1d3-4e52-90a7-faf4621ce6fb"). InnerVolumeSpecName "kube-api-access-wppfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:06:26.130046 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.130005 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f911d009-b1d3-4e52-90a7-faf4621ce6fb-config-file\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:06:26.130046 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.130042 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wppfb\" (UniqueName: \"kubernetes.io/projected/f911d009-b1d3-4e52-90a7-faf4621ce6fb-kube-api-access-wppfb\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:06:26.842790 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.842760 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" Jun 10 15:06:26.843204 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.842763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zzpdn" event={"ID":"f911d009-b1d3-4e52-90a7-faf4621ce6fb","Type":"ContainerDied","Data":"aa6724512ceef528a2ed1bb8987091da7f8444a3f6f30ce947e8afab0385ff82"} Jun 10 15:06:26.843204 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.842906 2578 scope.go:117] "RemoveContainer" containerID="93454fd726d8d3bd27c13d050bc06754b27fd6830d64e00bb9cc4ecf64712166" Jun 10 15:06:26.867023 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.866999 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:26.879674 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:26.879649 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zzpdn"] Jun 10 15:06:27.437475 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437446 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj"] Jun 10 15:06:27.437762 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437751 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" containerName="limitador" Jun 10 15:06:27.437808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437764 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" containerName="limitador" Jun 10 15:06:27.437808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437772 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51690a98-9795-4195-ae19-251de9f08adf" containerName="authorino" Jun 10 15:06:27.437808 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437777 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="51690a98-9795-4195-ae19-251de9f08adf" containerName="authorino" Jun 10 15:06:27.437906 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437828 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" containerName="limitador" Jun 10 15:06:27.437906 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.437836 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="51690a98-9795-4195-ae19-251de9f08adf" containerName="authorino" Jun 10 15:06:27.440215 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.440187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.443732 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.443714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 10 15:06:27.444127 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.444112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 15:06:27.444642 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.444628 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-z2pgs\"" Jun 10 15:06:27.445844 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.445828 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 15:06:27.455215 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.455187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj"] Jun 10 15:06:27.541439 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.541404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2bcc3d0-6581-446d-a483-a7146cf91fd4-data\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.541439 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.541443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptfxq\" (UniqueName: \"kubernetes.io/projected/a2bcc3d0-6581-446d-a483-a7146cf91fd4-kube-api-access-ptfxq\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.642659 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.642622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2bcc3d0-6581-446d-a483-a7146cf91fd4-data\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.642659 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.642662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptfxq\" (UniqueName: \"kubernetes.io/projected/a2bcc3d0-6581-446d-a483-a7146cf91fd4-kube-api-access-ptfxq\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.643028 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.643010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a2bcc3d0-6581-446d-a483-a7146cf91fd4-data\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.652937 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.652908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptfxq\" (UniqueName: \"kubernetes.io/projected/a2bcc3d0-6581-446d-a483-a7146cf91fd4-kube-api-access-ptfxq\") pod \"postgres-69fb4594cf-zjkfj\" (UID: \"a2bcc3d0-6581-446d-a483-a7146cf91fd4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.750292 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.750218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:27.884952 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:27.884914 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj"] Jun 10 15:06:27.886560 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:06:27.886535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bcc3d0_6581_446d_a483_a7146cf91fd4.slice/crio-8a0343af52deeadb602c57cbaa4c670674ee4827ac81c95de38c797c968971b1 WatchSource:0}: Error finding container 8a0343af52deeadb602c57cbaa4c670674ee4827ac81c95de38c797c968971b1: Status 404 returned error can't find the container with id 8a0343af52deeadb602c57cbaa4c670674ee4827ac81c95de38c797c968971b1 Jun 10 15:06:28.297856 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:28.297820 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f911d009-b1d3-4e52-90a7-faf4621ce6fb" path="/var/lib/kubelet/pods/f911d009-b1d3-4e52-90a7-faf4621ce6fb/volumes" Jun 10 15:06:28.854468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:28.854436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" event={"ID":"a2bcc3d0-6581-446d-a483-a7146cf91fd4","Type":"ContainerStarted","Data":"8a0343af52deeadb602c57cbaa4c670674ee4827ac81c95de38c797c968971b1"} Jun 10 15:06:32.879617 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:32.879586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" event={"ID":"a2bcc3d0-6581-446d-a483-a7146cf91fd4","Type":"ContainerStarted","Data":"3cac165ef17e2a383f53708cb549b0e34bfb4ad79af810dfe81b1ea1a310d513"} Jun 10 15:06:32.880015 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:32.879727 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:06:32.908434 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:32.908383 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" podStartSLOduration=0.989502382 podStartE2EDuration="5.908367428s" totalImagesPullingTime="4.918865046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:32.906441814 +0000 UTC m=+673.024001539" watchObservedRunningTime="2026-06-10 15:06:32.908367428 +0000 UTC m=+673.025927152" Jun 10 15:06:38.912351 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:06:38.912320 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-zjkfj" Jun 10 15:07:05.920256 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.920180 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:07:05.923348 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.923326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:05.926013 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.925994 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 15:07:05.926109 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.926024 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 15:07:05.926109 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.926001 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 15:07:05.926781 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.926768 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jqjxj\"" Jun 10 15:07:05.935169 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.935150 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:07:05.977101 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:05.977063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69hx\" (UniqueName: \"kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx\") pod \"maas-keycloak-0\" (UID: \"ac4cbb00-bc63-404d-bbf3-9f3402ec7508\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:06.078244 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:06.078210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69hx\" (UniqueName: \"kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx\") pod \"maas-keycloak-0\" (UID: \"ac4cbb00-bc63-404d-bbf3-9f3402ec7508\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:06.094215 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:06.094185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69hx\" (UniqueName: \"kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx\") pod \"maas-keycloak-0\" (UID: \"ac4cbb00-bc63-404d-bbf3-9f3402ec7508\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:06.232306 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:06.232219 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:06.376182 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:06.376151 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:07:06.381872 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:07:06.381696 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4cbb00_bc63_404d_bbf3_9f3402ec7508.slice/crio-fe7def96a1bc6a8ecd91107acd3e51c1b22bbb7b396f8fa8a9fddf43a6b01119 WatchSource:0}: Error finding container fe7def96a1bc6a8ecd91107acd3e51c1b22bbb7b396f8fa8a9fddf43a6b01119: Status 404 returned error can't find the container with id fe7def96a1bc6a8ecd91107acd3e51c1b22bbb7b396f8fa8a9fddf43a6b01119 Jun 10 15:07:07.026173 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:07.026140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ac4cbb00-bc63-404d-bbf3-9f3402ec7508","Type":"ContainerStarted","Data":"fe7def96a1bc6a8ecd91107acd3e51c1b22bbb7b396f8fa8a9fddf43a6b01119"} Jun 10 15:07:14.063537 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:14.063497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ac4cbb00-bc63-404d-bbf3-9f3402ec7508","Type":"ContainerStarted","Data":"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d"} Jun 10 15:07:14.087007 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:14.086940 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.60129531 podStartE2EDuration="9.086926088s" totalImagesPullingTime="7.485630778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:07:14.086043276 +0000 UTC m=+714.203603027" watchObservedRunningTime="2026-06-10 15:07:14.086926088 +0000 UTC m=+714.204485811" Jun 10 15:07:14.233066 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:14.232973 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:14.234298 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:14.234264 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:15.233350 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:15.233296 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:16.232939 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:16.232895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:16.233309 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:16.233273 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:17.233318 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:17.233222 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:18.233726 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:18.233680 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:19.233096 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:19.233049 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:20.239390 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:20.239343 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:21.233222 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:21.233163 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:22.233149 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:22.233097 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:23.233061 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:23.233009 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:24.233346 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:24.233287 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:25.233253 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:25.233203 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:26.233253 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:26.233205 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 15:07:27.325095 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:27.325058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:27.344074 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:27.344023 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 15:07:37.332177 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:37.332143 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 15:07:38.307682 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.307650 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:38.310823 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.310805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:38.330594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.330569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:38.389690 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.389648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4cc\" (UniqueName: \"kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc\") pod \"authorino-5d4b67c446-kgxxl\" (UID: \"8e5ee093-07d4-4bae-8db1-ad5235929da4\") " pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:38.490186 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.490154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4cc\" (UniqueName: \"kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc\") pod \"authorino-5d4b67c446-kgxxl\" (UID: \"8e5ee093-07d4-4bae-8db1-ad5235929da4\") " pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:38.498984 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.498938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4cc\" (UniqueName: \"kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc\") pod \"authorino-5d4b67c446-kgxxl\" (UID: \"8e5ee093-07d4-4bae-8db1-ad5235929da4\") " pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:38.529514 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.529487 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:38.529738 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.529725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:38.572365 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.572342 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d47df65b6-ntksk"] Jun 10 15:07:38.576224 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.576203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:38.589575 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.589549 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d47df65b6-ntksk"] Jun 10 15:07:38.664663 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.664637 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:38.666633 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:07:38.666605 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e5ee093_07d4_4bae_8db1_ad5235929da4.slice/crio-ec47ce99922980c2f505f6e978436e21fcae2cc3689395ccc6e4273925980424 WatchSource:0}: Error finding container ec47ce99922980c2f505f6e978436e21fcae2cc3689395ccc6e4273925980424: Status 404 returned error can't find the container with id ec47ce99922980c2f505f6e978436e21fcae2cc3689395ccc6e4273925980424 Jun 10 15:07:38.691832 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.691812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns5t5\" (UniqueName: \"kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5\") pod \"authorino-d47df65b6-ntksk\" (UID: \"cc94832b-be88-4fad-8b31-8fa5d9bf5d98\") " pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:38.792321 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.792286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns5t5\" (UniqueName: \"kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5\") pod \"authorino-d47df65b6-ntksk\" (UID: \"cc94832b-be88-4fad-8b31-8fa5d9bf5d98\") " pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:38.800047 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.800015 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d47df65b6-ntksk"] Jun 10 15:07:38.800277 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:07:38.800257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ns5t5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-d47df65b6-ntksk" podUID="cc94832b-be88-4fad-8b31-8fa5d9bf5d98" Jun 10 15:07:38.803101 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.803071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns5t5\" (UniqueName: \"kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5\") pod \"authorino-d47df65b6-ntksk\" (UID: \"cc94832b-be88-4fad-8b31-8fa5d9bf5d98\") " pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:38.856594 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.856520 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:07:38.860328 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.860310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:38.866417 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.866394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 15:07:38.873871 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.873847 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:07:38.993984 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.993928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:38.994134 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:38.994003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2624\" (UniqueName: \"kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.095049 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.095017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.095191 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.095060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2624\" (UniqueName: \"kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.097443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.097419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.115530 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.115468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2624\" (UniqueName: \"kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624\") pod \"authorino-66f7899f9d-jdf82\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.169456 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.169424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:07:39.199048 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.199022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:39.199048 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.199017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" event={"ID":"8e5ee093-07d4-4bae-8db1-ad5235929da4","Type":"ContainerStarted","Data":"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb"} Jun 10 15:07:39.199273 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.199077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" event={"ID":"8e5ee093-07d4-4bae-8db1-ad5235929da4","Type":"ContainerStarted","Data":"ec47ce99922980c2f505f6e978436e21fcae2cc3689395ccc6e4273925980424"} Jun 10 15:07:39.199273 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.199112 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" podUID="8e5ee093-07d4-4bae-8db1-ad5235929da4" containerName="authorino" containerID="cri-o://2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb" gracePeriod=30 Jun 10 15:07:39.207339 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.207318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:39.225143 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.225100 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" podStartSLOduration=0.88468767 podStartE2EDuration="1.225082932s" totalImagesPullingTime="340.395262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:07:39.222552081 +0000 UTC m=+739.340111818" watchObservedRunningTime="2026-06-10 15:07:39.225082932 +0000 UTC m=+739.342642655" Jun 10 15:07:39.296799 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.296770 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns5t5\" (UniqueName: \"kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5\") pod \"cc94832b-be88-4fad-8b31-8fa5d9bf5d98\" (UID: \"cc94832b-be88-4fad-8b31-8fa5d9bf5d98\") " Jun 10 15:07:39.298650 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.298626 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5" (OuterVolumeSpecName: "kube-api-access-ns5t5") pod "cc94832b-be88-4fad-8b31-8fa5d9bf5d98" (UID: "cc94832b-be88-4fad-8b31-8fa5d9bf5d98"). InnerVolumeSpecName "kube-api-access-ns5t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:07:39.306553 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.306532 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:07:39.307927 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:07:39.307906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b6409c6_bc84_4edd_9881_c7170356e3e9.slice/crio-9ea9084e758229e8079355ffb84b1ec6cee5fb96b6bc7739ba4788b6c1fcb2ab WatchSource:0}: Error finding container 9ea9084e758229e8079355ffb84b1ec6cee5fb96b6bc7739ba4788b6c1fcb2ab: Status 404 returned error can't find the container with id 9ea9084e758229e8079355ffb84b1ec6cee5fb96b6bc7739ba4788b6c1fcb2ab Jun 10 15:07:39.397779 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.397704 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns5t5\" (UniqueName: \"kubernetes.io/projected/cc94832b-be88-4fad-8b31-8fa5d9bf5d98-kube-api-access-ns5t5\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:07:39.423620 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.423597 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:39.498771 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.498734 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz4cc\" (UniqueName: \"kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc\") pod \"8e5ee093-07d4-4bae-8db1-ad5235929da4\" (UID: \"8e5ee093-07d4-4bae-8db1-ad5235929da4\") " Jun 10 15:07:39.500753 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.500730 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc" (OuterVolumeSpecName: "kube-api-access-bz4cc") pod "8e5ee093-07d4-4bae-8db1-ad5235929da4" (UID: "8e5ee093-07d4-4bae-8db1-ad5235929da4"). InnerVolumeSpecName "kube-api-access-bz4cc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:07:39.599614 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:39.599578 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz4cc\" (UniqueName: \"kubernetes.io/projected/8e5ee093-07d4-4bae-8db1-ad5235929da4-kube-api-access-bz4cc\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:07:40.204224 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.204190 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e5ee093-07d4-4bae-8db1-ad5235929da4" containerID="2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb" exitCode=0 Jun 10 15:07:40.204379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.204245 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" Jun 10 15:07:40.204379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.204286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" event={"ID":"8e5ee093-07d4-4bae-8db1-ad5235929da4","Type":"ContainerDied","Data":"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb"} Jun 10 15:07:40.204379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.204327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kgxxl" event={"ID":"8e5ee093-07d4-4bae-8db1-ad5235929da4","Type":"ContainerDied","Data":"ec47ce99922980c2f505f6e978436e21fcae2cc3689395ccc6e4273925980424"} Jun 10 15:07:40.204379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.204348 2578 scope.go:117] "RemoveContainer" containerID="2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb" Jun 10 15:07:40.205878 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.205846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f7899f9d-jdf82" event={"ID":"5b6409c6-bc84-4edd-9881-c7170356e3e9","Type":"ContainerStarted","Data":"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820"} Jun 10 15:07:40.206006 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.205890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f7899f9d-jdf82" event={"ID":"5b6409c6-bc84-4edd-9881-c7170356e3e9","Type":"ContainerStarted","Data":"9ea9084e758229e8079355ffb84b1ec6cee5fb96b6bc7739ba4788b6c1fcb2ab"} Jun 10 15:07:40.206006 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.205930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d47df65b6-ntksk" Jun 10 15:07:40.212691 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.212666 2578 scope.go:117] "RemoveContainer" containerID="2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb" Jun 10 15:07:40.212938 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:07:40.212920 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb\": container with ID starting with 2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb not found: ID does not exist" containerID="2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb" Jun 10 15:07:40.213041 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.212959 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb"} err="failed to get container status \"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb\": rpc error: code = NotFound desc = could not find container \"2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb\": container with ID starting with 2445ebea6bc9a72405826d3384ec32d87dcbed0063d13ca1a26b5ff094e5c9cb not found: ID does not exist" Jun 10 15:07:40.225002 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.224940 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66f7899f9d-jdf82" podStartSLOduration=1.831920483 podStartE2EDuration="2.224928949s" totalImagesPullingTime="393.008466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:07:40.22375221 +0000 UTC m=+740.341311937" watchObservedRunningTime="2026-06-10 15:07:40.224928949 +0000 UTC m=+740.342488673" Jun 10 15:07:40.251164 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.251132 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d47df65b6-ntksk"] Jun 10 15:07:40.253089 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.253062 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:07:40.253277 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.253251 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nd6zn" podUID="fa176ce0-15df-4819-9ada-23e34abc783f" containerName="authorino" containerID="cri-o://2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca" gracePeriod=30 Jun 10 15:07:40.254557 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.254537 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d47df65b6-ntksk"] Jun 10 15:07:40.266735 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.266711 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:40.270166 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.270145 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kgxxl"] Jun 10 15:07:40.298733 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.298705 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5ee093-07d4-4bae-8db1-ad5235929da4" path="/var/lib/kubelet/pods/8e5ee093-07d4-4bae-8db1-ad5235929da4/volumes" Jun 10 15:07:40.299041 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.299028 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc94832b-be88-4fad-8b31-8fa5d9bf5d98" path="/var/lib/kubelet/pods/cc94832b-be88-4fad-8b31-8fa5d9bf5d98/volumes" Jun 10 15:07:40.494521 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.494496 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:07:40.607885 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.607856 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrcjb\" (UniqueName: \"kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb\") pod \"fa176ce0-15df-4819-9ada-23e34abc783f\" (UID: \"fa176ce0-15df-4819-9ada-23e34abc783f\") " Jun 10 15:07:40.610047 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.610016 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb" (OuterVolumeSpecName: "kube-api-access-mrcjb") pod "fa176ce0-15df-4819-9ada-23e34abc783f" (UID: "fa176ce0-15df-4819-9ada-23e34abc783f"). InnerVolumeSpecName "kube-api-access-mrcjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:07:40.709447 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:40.709414 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrcjb\" (UniqueName: \"kubernetes.io/projected/fa176ce0-15df-4819-9ada-23e34abc783f-kube-api-access-mrcjb\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:07:41.212175 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.212142 2578 generic.go:356] "Generic (PLEG): container finished" podID="fa176ce0-15df-4819-9ada-23e34abc783f" containerID="2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca" exitCode=0 Jun 10 15:07:41.212370 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.212187 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd6zn" Jun 10 15:07:41.212370 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.212226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6zn" event={"ID":"fa176ce0-15df-4819-9ada-23e34abc783f","Type":"ContainerDied","Data":"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca"} Jun 10 15:07:41.212370 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.212264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd6zn" event={"ID":"fa176ce0-15df-4819-9ada-23e34abc783f","Type":"ContainerDied","Data":"9110839ab385ff6bb536fa62b6ddd32136ca6f19ae558da896dbeec47648262c"} Jun 10 15:07:41.212370 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.212281 2578 scope.go:117] "RemoveContainer" containerID="2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca" Jun 10 15:07:41.220619 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.220602 2578 scope.go:117] "RemoveContainer" containerID="2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca" Jun 10 15:07:41.220872 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:07:41.220856 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca\": container with ID starting with 2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca not found: ID does not exist" containerID="2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca" Jun 10 15:07:41.220915 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.220880 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca"} err="failed to get container status \"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca\": rpc error: code = NotFound desc = could not find container \"2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca\": container with ID starting with 2c105606af1cee254c0d22605e9640cf593d2fadebe938da5ce19b153b05e7ca not found: ID does not exist" Jun 10 15:07:41.233817 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.233792 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:07:41.236125 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:41.236104 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd6zn"] Jun 10 15:07:42.297320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:42.297288 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa176ce0-15df-4819-9ada-23e34abc783f" path="/var/lib/kubelet/pods/fa176ce0-15df-4819-9ada-23e34abc783f/volumes" Jun 10 15:07:44.224897 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.224866 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:07:44.225276 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225236 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5ee093-07d4-4bae-8db1-ad5235929da4" containerName="authorino" Jun 10 15:07:44.225276 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225248 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5ee093-07d4-4bae-8db1-ad5235929da4" containerName="authorino" Jun 10 15:07:44.225276 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225270 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa176ce0-15df-4819-9ada-23e34abc783f" containerName="authorino" Jun 10 15:07:44.225276 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225275 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa176ce0-15df-4819-9ada-23e34abc783f" containerName="authorino" Jun 10 15:07:44.225405 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225320 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa176ce0-15df-4819-9ada-23e34abc783f" containerName="authorino" Jun 10 15:07:44.225405 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.225333 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5ee093-07d4-4bae-8db1-ad5235929da4" containerName="authorino" Jun 10 15:07:44.256734 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.256705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:07:44.256884 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.256801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.260386 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.260361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 15:07:44.260506 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.260406 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pmsbl\"" Jun 10 15:07:44.260506 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.260406 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 15:07:44.342713 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.342681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.342855 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.342755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv2hv\" (UniqueName: \"kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.443864 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.443831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv2hv\" (UniqueName: \"kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.444050 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.443896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.446284 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.446252 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.453417 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.453390 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv2hv\" (UniqueName: \"kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv\") pod \"maas-controller-55bd48f54b-jfwcb\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.566814 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.566729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:44.723838 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:44.723802 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:07:44.726829 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:07:44.726799 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efe4a98_1283_4513_9055_94db2308a89e.slice/crio-4b62a0b1a175e7644e736f830d187c48b10f8beac3f7fdfc3216fef25faf89eb WatchSource:0}: Error finding container 4b62a0b1a175e7644e736f830d187c48b10f8beac3f7fdfc3216fef25faf89eb: Status 404 returned error can't find the container with id 4b62a0b1a175e7644e736f830d187c48b10f8beac3f7fdfc3216fef25faf89eb Jun 10 15:07:45.233079 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:45.233042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" event={"ID":"0efe4a98-1283-4513-9055-94db2308a89e","Type":"ContainerStarted","Data":"4b62a0b1a175e7644e736f830d187c48b10f8beac3f7fdfc3216fef25faf89eb"} Jun 10 15:07:48.249455 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:48.249419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" event={"ID":"0efe4a98-1283-4513-9055-94db2308a89e","Type":"ContainerStarted","Data":"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec"} Jun 10 15:07:48.250153 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:48.249491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:59.260838 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:59.260803 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:07:59.280142 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:07:59.280091 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" podStartSLOduration=12.787182233 podStartE2EDuration="15.280078061s" totalImagesPullingTime="2.492895828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:07:48.273886157 +0000 UTC m=+748.391445881" watchObservedRunningTime="2026-06-10 15:07:59.280078061 +0000 UTC m=+759.397637784" Jun 10 15:08:18.722289 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.722248 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz"] Jun 10 15:08:18.726764 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.726747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.729425 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.729404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-kcmlr\"" Jun 10 15:08:18.729644 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.729626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 15:08:18.741272 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.741243 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz"] Jun 10 15:08:18.845391 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.845357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-maas-api-tls\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.845555 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.845423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjktv\" (UniqueName: \"kubernetes.io/projected/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-kube-api-access-zjktv\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.946778 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.946744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjktv\" (UniqueName: \"kubernetes.io/projected/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-kube-api-access-zjktv\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.946929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.946813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-maas-api-tls\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.949211 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.949180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-maas-api-tls\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:18.956233 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:18.956206 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjktv\" (UniqueName: \"kubernetes.io/projected/0d82ac0c-2a83-423d-843a-d0894a8dd7f9-kube-api-access-zjktv\") pod \"maas-api-86bb9669b8-swxtz\" (UID: \"0d82ac0c-2a83-423d-843a-d0894a8dd7f9\") " pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:19.037096 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.037015 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:19.176621 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.176579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz"] Jun 10 15:08:19.178997 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:08:19.178959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d82ac0c_2a83_423d_843a_d0894a8dd7f9.slice/crio-aa002c00b14cd63be78bae63219870c3d26ec2ef05800efd5d7c0f7e50fa16f4 WatchSource:0}: Error finding container aa002c00b14cd63be78bae63219870c3d26ec2ef05800efd5d7c0f7e50fa16f4: Status 404 returned error can't find the container with id aa002c00b14cd63be78bae63219870c3d26ec2ef05800efd5d7c0f7e50fa16f4 Jun 10 15:08:19.180342 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.180322 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:08:19.384481 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.384442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" event={"ID":"0d82ac0c-2a83-423d-843a-d0894a8dd7f9","Type":"ContainerStarted","Data":"aa002c00b14cd63be78bae63219870c3d26ec2ef05800efd5d7c0f7e50fa16f4"} Jun 10 15:08:19.437616 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.437576 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cbbbm"] Jun 10 15:08:19.441159 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.441135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:19.444031 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.443993 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 15:08:19.444208 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.444195 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6ljjh\"" Jun 10 15:08:19.453921 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.453896 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cbbbm"] Jun 10 15:08:19.552449 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.552416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qz8n\" (UniqueName: \"kubernetes.io/projected/31042442-d4e5-4653-8147-ed570da4eabb-kube-api-access-6qz8n\") pod \"payload-pre-processing-579785bc64-cbbbm\" (UID: \"31042442-d4e5-4653-8147-ed570da4eabb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:19.653563 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.653470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qz8n\" (UniqueName: \"kubernetes.io/projected/31042442-d4e5-4653-8147-ed570da4eabb-kube-api-access-6qz8n\") pod \"payload-pre-processing-579785bc64-cbbbm\" (UID: \"31042442-d4e5-4653-8147-ed570da4eabb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:19.671941 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.671911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qz8n\" (UniqueName: \"kubernetes.io/projected/31042442-d4e5-4653-8147-ed570da4eabb-kube-api-access-6qz8n\") pod \"payload-pre-processing-579785bc64-cbbbm\" (UID: \"31042442-d4e5-4653-8147-ed570da4eabb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:19.752046 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.752007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:19.880369 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:19.880340 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cbbbm"] Jun 10 15:08:19.882251 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:08:19.882227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31042442_d4e5_4653_8147_ed570da4eabb.slice/crio-6a992cd38af4adfb8da9fd80a76df3594127e336d62a6f366f7fa89359cab58a WatchSource:0}: Error finding container 6a992cd38af4adfb8da9fd80a76df3594127e336d62a6f366f7fa89359cab58a: Status 404 returned error can't find the container with id 6a992cd38af4adfb8da9fd80a76df3594127e336d62a6f366f7fa89359cab58a Jun 10 15:08:20.389752 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:20.389719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" event={"ID":"31042442-d4e5-4653-8147-ed570da4eabb","Type":"ContainerStarted","Data":"6a992cd38af4adfb8da9fd80a76df3594127e336d62a6f366f7fa89359cab58a"} Jun 10 15:08:22.254454 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.254427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 15:08:22.400238 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.400203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" event={"ID":"31042442-d4e5-4653-8147-ed570da4eabb","Type":"ContainerStarted","Data":"b3e885e2f0dfa553c81cd600b64f33ea1d54a0f0c2474e136f1a3990e0a99421"} Jun 10 15:08:22.400417 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.400293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:22.401673 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.401644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" event={"ID":"0d82ac0c-2a83-423d-843a-d0894a8dd7f9","Type":"ContainerStarted","Data":"963541b0cc9088a1139c454263655daac16a03b6e357f947cbe47ba326cf9bd6"} Jun 10 15:08:22.401779 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.401760 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:22.418144 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.418103 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" podStartSLOduration=1.050388712 podStartE2EDuration="3.418088715s" totalImagesPullingTime="2.367700003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:08:22.417017824 +0000 UTC m=+782.534577560" watchObservedRunningTime="2026-06-10 15:08:22.418088715 +0000 UTC m=+782.535648418" Jun 10 15:08:22.437543 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:22.437501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" podStartSLOduration=1.3892785779999999 podStartE2EDuration="4.437484062s" totalImagesPullingTime="3.048205484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:08:22.435302859 +0000 UTC m=+782.552862585" watchObservedRunningTime="2026-06-10 15:08:22.437484062 +0000 UTC m=+782.555043786" Jun 10 15:08:28.411839 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:28.411809 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-86bb9669b8-swxtz" Jun 10 15:08:30.413327 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:30.413291 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:30.413862 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:30.413477 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" containerID="cri-o://a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d" gracePeriod=30 Jun 10 15:08:31.958760 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:31.958737 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.074204 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.074174 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w69hx\" (UniqueName: \"kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx\") pod \"ac4cbb00-bc63-404d-bbf3-9f3402ec7508\" (UID: \"ac4cbb00-bc63-404d-bbf3-9f3402ec7508\") " Jun 10 15:08:32.076317 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.076290 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx" (OuterVolumeSpecName: "kube-api-access-w69hx") pod "ac4cbb00-bc63-404d-bbf3-9f3402ec7508" (UID: "ac4cbb00-bc63-404d-bbf3-9f3402ec7508"). InnerVolumeSpecName "kube-api-access-w69hx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:08:32.175379 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.175342 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w69hx\" (UniqueName: \"kubernetes.io/projected/ac4cbb00-bc63-404d-bbf3-9f3402ec7508-kube-api-access-w69hx\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:08:32.448397 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.448312 2578 generic.go:356] "Generic (PLEG): container finished" podID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerID="a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d" exitCode=143 Jun 10 15:08:32.448397 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.448353 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.448569 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.448396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ac4cbb00-bc63-404d-bbf3-9f3402ec7508","Type":"ContainerDied","Data":"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d"} Jun 10 15:08:32.448569 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.448444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ac4cbb00-bc63-404d-bbf3-9f3402ec7508","Type":"ContainerDied","Data":"fe7def96a1bc6a8ecd91107acd3e51c1b22bbb7b396f8fa8a9fddf43a6b01119"} Jun 10 15:08:32.448569 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.448467 2578 scope.go:117] "RemoveContainer" containerID="a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d" Jun 10 15:08:32.457273 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.457256 2578 scope.go:117] "RemoveContainer" containerID="a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d" Jun 10 15:08:32.457526 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:08:32.457509 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d\": container with ID starting with a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d not found: ID does not exist" containerID="a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d" Jun 10 15:08:32.457579 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.457532 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d"} err="failed to get container status \"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d\": rpc error: code = NotFound desc = could not find container \"a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d\": container with ID starting with a1031b3866664481ae181763faba3090cd18c7d57064e80d40f94b384352d98d not found: ID does not exist" Jun 10 15:08:32.464042 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.464018 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:32.471924 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.471894 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:32.499906 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.499880 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:32.500302 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.500285 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" Jun 10 15:08:32.500384 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.500304 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" Jun 10 15:08:32.500440 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.500403 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" containerName="keycloak" Jun 10 15:08:32.502921 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.502903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.505693 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.505659 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 15:08:32.505693 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.505659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jqjxj\"" Jun 10 15:08:32.505861 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.505762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 15:08:32.505861 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.505798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 15:08:32.506006 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.505913 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 15:08:32.514751 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.514732 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:32.578230 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.578198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f8452e67-2be9-4950-aa5c-289a98a5332e-test-realms\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.578372 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.578263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnpx\" (UniqueName: \"kubernetes.io/projected/f8452e67-2be9-4950-aa5c-289a98a5332e-kube-api-access-plnpx\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.679723 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.679690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnpx\" (UniqueName: \"kubernetes.io/projected/f8452e67-2be9-4950-aa5c-289a98a5332e-kube-api-access-plnpx\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.679897 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.679764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f8452e67-2be9-4950-aa5c-289a98a5332e-test-realms\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.680446 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.680428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f8452e67-2be9-4950-aa5c-289a98a5332e-test-realms\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.687837 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.687808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnpx\" (UniqueName: \"kubernetes.io/projected/f8452e67-2be9-4950-aa5c-289a98a5332e-kube-api-access-plnpx\") pod \"maas-keycloak-0\" (UID: \"f8452e67-2be9-4950-aa5c-289a98a5332e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.812278 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.812185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:32.941785 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:32.941761 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 15:08:32.944007 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:08:32.943978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8452e67_2be9_4950_aa5c_289a98a5332e.slice/crio-ab4bf18554e162e9eba7ff6b857505606fed11e3f6f583cecf07912d2e7bfbad WatchSource:0}: Error finding container ab4bf18554e162e9eba7ff6b857505606fed11e3f6f583cecf07912d2e7bfbad: Status 404 returned error can't find the container with id ab4bf18554e162e9eba7ff6b857505606fed11e3f6f583cecf07912d2e7bfbad Jun 10 15:08:33.409377 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.409354 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cbbbm" Jun 10 15:08:33.456038 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.455991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f8452e67-2be9-4950-aa5c-289a98a5332e","Type":"ContainerStarted","Data":"ef11a4e892c8ba05195cd2f48ffa814831c51e7ec2b5a25bf9cafed97d40c04d"} Jun 10 15:08:33.456211 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.456052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f8452e67-2be9-4950-aa5c-289a98a5332e","Type":"ContainerStarted","Data":"ab4bf18554e162e9eba7ff6b857505606fed11e3f6f583cecf07912d2e7bfbad"} Jun 10 15:08:33.475523 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.475473 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.052680079 podStartE2EDuration="1.475457525s" totalImagesPullingTime="422.777446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:08:33.473659646 +0000 UTC m=+793.591219383" watchObservedRunningTime="2026-06-10 15:08:33.475457525 +0000 UTC m=+793.593017248" Jun 10 15:08:33.812672 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.812580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:33.814322 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:33.814288 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:34.298229 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:34.298194 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac4cbb00-bc63-404d-bbf3-9f3402ec7508" path="/var/lib/kubelet/pods/ac4cbb00-bc63-404d-bbf3-9f3402ec7508/volumes" Jun 10 15:08:34.812968 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:34.812904 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:35.813215 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:35.813170 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:36.812775 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:36.812720 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:37.813025 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:37.812980 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:38.813689 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:38.813632 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:39.812787 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:39.812740 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:40.813279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:40.813223 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:41.813524 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:41.813476 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:42.812869 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:42.812813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:42.813120 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:42.813087 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:43.812727 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:43.812669 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:44.813058 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:44.813015 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:45.812931 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:45.812884 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 15:08:46.937626 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:46.937584 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 15:08:46.958357 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:46.958294 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f8452e67-2be9-4950-aa5c-289a98a5332e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 15:08:56.943694 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:08:56.943647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 15:09:07.766165 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.766130 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:09:07.769071 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.769051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.771443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.771426 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 15:09:07.780454 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.780428 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:09:07.820131 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.820098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9xh\" (UniqueName: \"kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.820279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.820141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.820279 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.820172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.921425 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.921390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9xh\" (UniqueName: \"kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.921583 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.921448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.921583 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.921493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.922181 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.922152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.923773 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.923758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:07.930921 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:07.930895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9xh\" (UniqueName: \"kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh\") pod \"authorino-5479dd6c56-5bngh\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:08.078610 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:08.078574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:09:08.205194 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:08.205168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:09:08.207842 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:09:08.207813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9f6ca17_f434_47e9_b809_863b5d315f14.slice/crio-e5b726ac036fe15c6c31c680bfb8e73bb015261dc14ac01587932ea8a9ac6aa9 WatchSource:0}: Error finding container e5b726ac036fe15c6c31c680bfb8e73bb015261dc14ac01587932ea8a9ac6aa9: Status 404 returned error can't find the container with id e5b726ac036fe15c6c31c680bfb8e73bb015261dc14ac01587932ea8a9ac6aa9 Jun 10 15:09:08.652562 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:08.652530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479dd6c56-5bngh" event={"ID":"c9f6ca17-f434-47e9-b809-863b5d315f14","Type":"ContainerStarted","Data":"e5b726ac036fe15c6c31c680bfb8e73bb015261dc14ac01587932ea8a9ac6aa9"} Jun 10 15:09:09.658027 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:09.657987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479dd6c56-5bngh" event={"ID":"c9f6ca17-f434-47e9-b809-863b5d315f14","Type":"ContainerStarted","Data":"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7"} Jun 10 15:09:09.675294 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:09.675243 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5479dd6c56-5bngh" podStartSLOduration=2.270050286 podStartE2EDuration="2.675228428s" totalImagesPullingTime="405.178142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:09:09.674762093 +0000 UTC m=+829.792321818" watchObservedRunningTime="2026-06-10 15:09:09.675228428 +0000 UTC m=+829.792788152" Jun 10 15:09:09.704362 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:09.704326 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:09:09.704520 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:09.704500 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-66f7899f9d-jdf82" podUID="5b6409c6-bc84-4edd-9881-c7170356e3e9" containerName="authorino" containerID="cri-o://818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820" gracePeriod=30 Jun 10 15:09:09.961320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:09.961295 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:09:10.040187 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.040152 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2624\" (UniqueName: \"kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624\") pod \"5b6409c6-bc84-4edd-9881-c7170356e3e9\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " Jun 10 15:09:10.040342 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.040246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert\") pod \"5b6409c6-bc84-4edd-9881-c7170356e3e9\" (UID: \"5b6409c6-bc84-4edd-9881-c7170356e3e9\") " Jun 10 15:09:10.042174 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.042137 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624" (OuterVolumeSpecName: "kube-api-access-b2624") pod "5b6409c6-bc84-4edd-9881-c7170356e3e9" (UID: "5b6409c6-bc84-4edd-9881-c7170356e3e9"). InnerVolumeSpecName "kube-api-access-b2624". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:09:10.049493 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.049461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5b6409c6-bc84-4edd-9881-c7170356e3e9" (UID: "5b6409c6-bc84-4edd-9881-c7170356e3e9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:09:10.141117 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.141084 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b6409c6-bc84-4edd-9881-c7170356e3e9-tls-cert\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:09:10.141117 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.141112 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2624\" (UniqueName: \"kubernetes.io/projected/5b6409c6-bc84-4edd-9881-c7170356e3e9-kube-api-access-b2624\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:09:10.664552 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.664515 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b6409c6-bc84-4edd-9881-c7170356e3e9" containerID="818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820" exitCode=0 Jun 10 15:09:10.664929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.664556 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f7899f9d-jdf82" Jun 10 15:09:10.664929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.664596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f7899f9d-jdf82" event={"ID":"5b6409c6-bc84-4edd-9881-c7170356e3e9","Type":"ContainerDied","Data":"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820"} Jun 10 15:09:10.664929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.664635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f7899f9d-jdf82" event={"ID":"5b6409c6-bc84-4edd-9881-c7170356e3e9","Type":"ContainerDied","Data":"9ea9084e758229e8079355ffb84b1ec6cee5fb96b6bc7739ba4788b6c1fcb2ab"} Jun 10 15:09:10.664929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.664655 2578 scope.go:117] "RemoveContainer" containerID="818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820" Jun 10 15:09:10.672860 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.672841 2578 scope.go:117] "RemoveContainer" containerID="818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820" Jun 10 15:09:10.673195 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:09:10.673172 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820\": container with ID starting with 818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820 not found: ID does not exist" containerID="818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820" Jun 10 15:09:10.673282 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.673200 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820"} err="failed to get container status \"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820\": rpc error: code = NotFound desc = could not find container \"818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820\": container with ID starting with 818faa7742b721e494a0bf97156662517344b2fe6e4436a84412c840c0f45820 not found: ID does not exist" Jun 10 15:09:10.687180 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.687160 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:09:10.694376 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:10.694356 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66f7899f9d-jdf82"] Jun 10 15:09:12.297761 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:12.297723 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6409c6-bc84-4edd-9881-c7170356e3e9" path="/var/lib/kubelet/pods/5b6409c6-bc84-4edd-9881-c7170356e3e9/volumes" Jun 10 15:09:29.059800 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.059767 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb"] Jun 10 15:09:29.060344 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.060324 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6409c6-bc84-4edd-9881-c7170356e3e9" containerName="authorino" Jun 10 15:09:29.060436 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.060346 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6409c6-bc84-4edd-9881-c7170356e3e9" containerName="authorino" Jun 10 15:09:29.060493 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.060444 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6409c6-bc84-4edd-9881-c7170356e3e9" containerName="authorino" Jun 10 15:09:29.063748 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.063728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.067642 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.067605 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 15:09:29.067773 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.067606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 15:09:29.067773 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.067611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 15:09:29.067773 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.067611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pbz7s\"" Jun 10 15:09:29.075742 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.075718 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb"] Jun 10 15:09:29.110560 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.110560 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb9dv\" (UniqueName: \"kubernetes.io/projected/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kube-api-access-bb9dv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.110786 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.110786 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.110786 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.110786 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.110769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.211863 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.211830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212091 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.211929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212091 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.211996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb9dv\" (UniqueName: \"kubernetes.io/projected/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kube-api-access-bb9dv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212091 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212091 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212304 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212377 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212377 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.212486 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.212404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.214319 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.214298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.214596 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.214579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.219807 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.219787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb9dv\" (UniqueName: \"kubernetes.io/projected/5ea0f2e0-a88e-43e9-9545-c3d26e1442de-kube-api-access-bb9dv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-x9qgb\" (UID: \"5ea0f2e0-a88e-43e9-9545-c3d26e1442de\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.373574 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.373545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:29.520838 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.520815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb"] Jun 10 15:09:29.522865 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:09:29.522842 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea0f2e0_a88e_43e9_9545_c3d26e1442de.slice/crio-2225609ab475ce08764947104594500bb7f92809e1ce3d51bee4e2fab57a8aab WatchSource:0}: Error finding container 2225609ab475ce08764947104594500bb7f92809e1ce3d51bee4e2fab57a8aab: Status 404 returned error can't find the container with id 2225609ab475ce08764947104594500bb7f92809e1ce3d51bee4e2fab57a8aab Jun 10 15:09:29.750636 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:29.750554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" event={"ID":"5ea0f2e0-a88e-43e9-9545-c3d26e1442de","Type":"ContainerStarted","Data":"2225609ab475ce08764947104594500bb7f92809e1ce3d51bee4e2fab57a8aab"} Jun 10 15:09:33.771717 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:33.771629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" event={"ID":"5ea0f2e0-a88e-43e9-9545-c3d26e1442de","Type":"ContainerStarted","Data":"a7f1f7482b976344123bd38d28392feb394838a3e9ae104663b49ecb61646e8c"} Jun 10 15:09:35.782281 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:35.782248 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ea0f2e0-a88e-43e9-9545-c3d26e1442de" containerID="a7f1f7482b976344123bd38d28392feb394838a3e9ae104663b49ecb61646e8c" exitCode=0 Jun 10 15:09:35.782675 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:35.782325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" event={"ID":"5ea0f2e0-a88e-43e9-9545-c3d26e1442de","Type":"ContainerDied","Data":"a7f1f7482b976344123bd38d28392feb394838a3e9ae104663b49ecb61646e8c"} Jun 10 15:09:37.794302 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:37.794267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" event={"ID":"5ea0f2e0-a88e-43e9-9545-c3d26e1442de","Type":"ContainerStarted","Data":"04a7c34c74ed33df5caec7117ef803b2c0aead974c3f3573d77a7b8724788bb8"} Jun 10 15:09:37.816328 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:37.816274 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" podStartSLOduration=1.524765487 podStartE2EDuration="8.816255448s" totalImagesPullingTime="5.2653173s" totalInitContainerRuntime="2.026172661s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:09:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:09:37.815104698 +0000 UTC m=+857.932664422" watchObservedRunningTime="2026-06-10 15:09:37.816255448 +0000 UTC m=+857.933815173" Jun 10 15:09:39.374069 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:39.374034 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:39.374541 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:39.374089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:39.386248 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:39.386218 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:39.816537 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:39.816462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-x9qgb" Jun 10 15:09:55.206023 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.205989 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2"] Jun 10 15:09:55.218017 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.217996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.222239 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.222213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 15:09:55.237698 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.237672 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2"] Jun 10 15:09:55.350619 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.350752 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.350752 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ms7c\" (UniqueName: \"kubernetes.io/projected/01eeb463-7608-4104-9e83-34f2ea4411f0-kube-api-access-4ms7c\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.350752 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.350872 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01eeb463-7608-4104-9e83-34f2ea4411f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.350872 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.350789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.451968 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.451912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.451968 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.451964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ms7c\" (UniqueName: \"kubernetes.io/projected/01eeb463-7608-4104-9e83-34f2ea4411f0-kube-api-access-4ms7c\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452206 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452206 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01eeb463-7608-4104-9e83-34f2ea4411f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452206 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452206 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452479 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452537 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.452590 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.452538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.454193 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.454172 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01eeb463-7608-4104-9e83-34f2ea4411f0-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.454575 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.454559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01eeb463-7608-4104-9e83-34f2ea4411f0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.463000 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.462925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ms7c\" (UniqueName: \"kubernetes.io/projected/01eeb463-7608-4104-9e83-34f2ea4411f0-kube-api-access-4ms7c\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2\" (UID: \"01eeb463-7608-4104-9e83-34f2ea4411f0\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.552525 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.552490 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:09:55.693154 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.693126 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2"] Jun 10 15:09:55.694041 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:09:55.694014 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01eeb463_7608_4104_9e83_34f2ea4411f0.slice/crio-8eeeb13aa686e05352a207387a4551cd62997452f2f22ae7653f647e2b3ebb3c WatchSource:0}: Error finding container 8eeeb13aa686e05352a207387a4551cd62997452f2f22ae7653f647e2b3ebb3c: Status 404 returned error can't find the container with id 8eeeb13aa686e05352a207387a4551cd62997452f2f22ae7653f647e2b3ebb3c Jun 10 15:09:55.876747 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.876712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" event={"ID":"01eeb463-7608-4104-9e83-34f2ea4411f0","Type":"ContainerStarted","Data":"22a59c6089fb9f2f3b80d0c0eb336456d043ed7f2d614d1cb490be37d2ed1a47"} Jun 10 15:09:55.876914 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:55.876767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" event={"ID":"01eeb463-7608-4104-9e83-34f2ea4411f0","Type":"ContainerStarted","Data":"8eeeb13aa686e05352a207387a4551cd62997452f2f22ae7653f647e2b3ebb3c"} Jun 10 15:09:57.886411 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:57.886374 2578 generic.go:356] "Generic (PLEG): container finished" podID="01eeb463-7608-4104-9e83-34f2ea4411f0" containerID="22a59c6089fb9f2f3b80d0c0eb336456d043ed7f2d614d1cb490be37d2ed1a47" exitCode=0 Jun 10 15:09:57.886796 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:57.886447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" event={"ID":"01eeb463-7608-4104-9e83-34f2ea4411f0","Type":"ContainerDied","Data":"22a59c6089fb9f2f3b80d0c0eb336456d043ed7f2d614d1cb490be37d2ed1a47"} Jun 10 15:09:58.892627 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:58.892594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" event={"ID":"01eeb463-7608-4104-9e83-34f2ea4411f0","Type":"ContainerStarted","Data":"31d60f2ef934b35763a3552ea5d529007b7d17d601ce233fa99004248e3b80df"} Jun 10 15:09:58.915340 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:09:58.915291 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" podStartSLOduration=1.753079145 podStartE2EDuration="3.915250821s" totalImagesPullingTime="245.15458ms" totalInitContainerRuntime="1.917017096s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:09:58.913375292 +0000 UTC m=+879.030935018" watchObservedRunningTime="2026-06-10 15:09:58.915250821 +0000 UTC m=+879.032810544" Jun 10 15:10:01.198269 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.198238 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2"] Jun 10 15:10:01.200871 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.200854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.217284 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.217262 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 15:10:01.243846 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.243816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2"] Jun 10 15:10:01.302179 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.302320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.302320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.302320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.302320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.302320 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.302316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxl2\" (UniqueName: \"kubernetes.io/projected/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kube-api-access-ztxl2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.403549 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.403743 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.403743 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.403865 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.403865 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.404013 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.403898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxl2\" (UniqueName: \"kubernetes.io/projected/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kube-api-access-ztxl2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.404421 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.404181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.404421 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.404341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.404421 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.404400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.405856 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.405838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.406262 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.406241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.421071 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.421045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxl2\" (UniqueName: \"kubernetes.io/projected/9ab1e7ed-00b0-4ef8-a22b-645fe58a1029-kube-api-access-ztxl2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zg7c2\" (UID: \"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.509587 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.509507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:01.675566 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.675539 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2"] Jun 10 15:10:01.677224 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:10:01.677203 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab1e7ed_00b0_4ef8_a22b_645fe58a1029.slice/crio-e09bac42bac74cf3354f968dd477eb2165b96fa883d133a3471319b84040834e WatchSource:0}: Error finding container e09bac42bac74cf3354f968dd477eb2165b96fa883d133a3471319b84040834e: Status 404 returned error can't find the container with id e09bac42bac74cf3354f968dd477eb2165b96fa883d133a3471319b84040834e Jun 10 15:10:01.908356 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.908319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" event={"ID":"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029","Type":"ContainerStarted","Data":"4b085850d2c8f19cd41b4da78aaed6720d768c3a430701c6b3172a86bc51c52c"} Jun 10 15:10:01.908356 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:01.908361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" event={"ID":"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029","Type":"ContainerStarted","Data":"e09bac42bac74cf3354f968dd477eb2165b96fa883d133a3471319b84040834e"} Jun 10 15:10:03.918847 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:03.918771 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ab1e7ed-00b0-4ef8-a22b-645fe58a1029" containerID="4b085850d2c8f19cd41b4da78aaed6720d768c3a430701c6b3172a86bc51c52c" exitCode=0 Jun 10 15:10:03.919200 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:03.918843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" event={"ID":"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029","Type":"ContainerDied","Data":"4b085850d2c8f19cd41b4da78aaed6720d768c3a430701c6b3172a86bc51c52c"} Jun 10 15:10:04.925595 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:04.925512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" event={"ID":"9ab1e7ed-00b0-4ef8-a22b-645fe58a1029","Type":"ContainerStarted","Data":"fabf4eb2539b20eb9e69fb7f22a86076d2cdf0be536473f1ee28a48cc8e53ab8"} Jun 10 15:10:04.947505 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:04.947453 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" podStartSLOduration=1.370419627 podStartE2EDuration="3.947440138s" totalImagesPullingTime="694.011925ms" totalInitContainerRuntime="1.883008586s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:10:04.946167171 +0000 UTC m=+885.063726896" watchObservedRunningTime="2026-06-10 15:10:04.947440138 +0000 UTC m=+885.064999861" Jun 10 15:10:05.553581 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:05.553543 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:10:05.553730 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:05.553654 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:10:05.566125 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:05.566097 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:10:05.941704 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:05.941669 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2" Jun 10 15:10:11.510402 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:11.510352 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:11.510402 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:11.510416 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:11.522769 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:11.522745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:11.972153 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:11.972119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zg7c2" Jun 10 15:10:20.308237 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:20.308208 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:10:20.310193 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:10:20.310174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:11:03.095323 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.095287 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54b78b6dfc-lhzz8"] Jun 10 15:11:03.097720 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.097701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.114230 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.114199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54b78b6dfc-lhzz8"] Jun 10 15:11:03.173868 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.173830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d299904e-c36e-4170-a6f5-b72aa553e39e-oidc-ca\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.174054 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.173972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl8s5\" (UniqueName: \"kubernetes.io/projected/d299904e-c36e-4170-a6f5-b72aa553e39e-kube-api-access-wl8s5\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.174054 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.174027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d299904e-c36e-4170-a6f5-b72aa553e39e-tls-cert\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.274892 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.274856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl8s5\" (UniqueName: \"kubernetes.io/projected/d299904e-c36e-4170-a6f5-b72aa553e39e-kube-api-access-wl8s5\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.275100 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.274907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d299904e-c36e-4170-a6f5-b72aa553e39e-tls-cert\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.275100 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.275041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d299904e-c36e-4170-a6f5-b72aa553e39e-oidc-ca\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.275706 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.275688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d299904e-c36e-4170-a6f5-b72aa553e39e-oidc-ca\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.277323 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.277306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d299904e-c36e-4170-a6f5-b72aa553e39e-tls-cert\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.288676 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.288646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl8s5\" (UniqueName: \"kubernetes.io/projected/d299904e-c36e-4170-a6f5-b72aa553e39e-kube-api-access-wl8s5\") pod \"authorino-54b78b6dfc-lhzz8\" (UID: \"d299904e-c36e-4170-a6f5-b72aa553e39e\") " pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.406933 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.406828 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" Jun 10 15:11:03.541558 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:03.541490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54b78b6dfc-lhzz8"] Jun 10 15:11:03.543911 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:11:03.543883 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd299904e_c36e_4170_a6f5_b72aa553e39e.slice/crio-666e9d3326f91a635f273c4aacdfb6dd46e63678caa325687f17ed262866bb4e WatchSource:0}: Error finding container 666e9d3326f91a635f273c4aacdfb6dd46e63678caa325687f17ed262866bb4e: Status 404 returned error can't find the container with id 666e9d3326f91a635f273c4aacdfb6dd46e63678caa325687f17ed262866bb4e Jun 10 15:11:04.209529 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.209486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" event={"ID":"d299904e-c36e-4170-a6f5-b72aa553e39e","Type":"ContainerStarted","Data":"d56125af925dbe68ff0f9f3378ffdaf84d9fe8f427553cf4c957259634ece30e"} Jun 10 15:11:04.209975 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.209539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" event={"ID":"d299904e-c36e-4170-a6f5-b72aa553e39e","Type":"ContainerStarted","Data":"666e9d3326f91a635f273c4aacdfb6dd46e63678caa325687f17ed262866bb4e"} Jun 10 15:11:04.232228 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.232116 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54b78b6dfc-lhzz8" podStartSLOduration=0.813439064 podStartE2EDuration="1.232095468s" totalImagesPullingTime="418.656404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:11:04.230558953 +0000 UTC m=+944.348118678" watchObservedRunningTime="2026-06-10 15:11:04.232095468 +0000 UTC m=+944.349655192" Jun 10 15:11:04.284971 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.283611 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:11:04.284971 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.283822 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5479dd6c56-5bngh" podUID="c9f6ca17-f434-47e9-b809-863b5d315f14" containerName="authorino" containerID="cri-o://a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7" gracePeriod=30 Jun 10 15:11:04.532481 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.532453 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:11:04.585187 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.585153 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert\") pod \"c9f6ca17-f434-47e9-b809-863b5d315f14\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " Jun 10 15:11:04.585356 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.585278 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca\") pod \"c9f6ca17-f434-47e9-b809-863b5d315f14\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " Jun 10 15:11:04.585407 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.585374 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf9xh\" (UniqueName: \"kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh\") pod \"c9f6ca17-f434-47e9-b809-863b5d315f14\" (UID: \"c9f6ca17-f434-47e9-b809-863b5d315f14\") " Jun 10 15:11:04.587858 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.587822 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh" (OuterVolumeSpecName: "kube-api-access-hf9xh") pod "c9f6ca17-f434-47e9-b809-863b5d315f14" (UID: "c9f6ca17-f434-47e9-b809-863b5d315f14"). InnerVolumeSpecName "kube-api-access-hf9xh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:11:04.590471 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.590442 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c9f6ca17-f434-47e9-b809-863b5d315f14" (UID: "c9f6ca17-f434-47e9-b809-863b5d315f14"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:11:04.595759 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.595735 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c9f6ca17-f434-47e9-b809-863b5d315f14" (UID: "c9f6ca17-f434-47e9-b809-863b5d315f14"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:11:04.686739 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.686709 2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9f6ca17-f434-47e9-b809-863b5d315f14-oidc-ca\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:11:04.686739 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.686736 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf9xh\" (UniqueName: \"kubernetes.io/projected/c9f6ca17-f434-47e9-b809-863b5d315f14-kube-api-access-hf9xh\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:11:04.686739 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:04.686746 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9f6ca17-f434-47e9-b809-863b5d315f14-tls-cert\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:11:05.216036 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.215999 2578 generic.go:356] "Generic (PLEG): container finished" podID="c9f6ca17-f434-47e9-b809-863b5d315f14" containerID="a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7" exitCode=0 Jun 10 15:11:05.216621 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.216053 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5479dd6c56-5bngh" Jun 10 15:11:05.216621 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.216099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479dd6c56-5bngh" event={"ID":"c9f6ca17-f434-47e9-b809-863b5d315f14","Type":"ContainerDied","Data":"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7"} Jun 10 15:11:05.216621 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.216151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5479dd6c56-5bngh" event={"ID":"c9f6ca17-f434-47e9-b809-863b5d315f14","Type":"ContainerDied","Data":"e5b726ac036fe15c6c31c680bfb8e73bb015261dc14ac01587932ea8a9ac6aa9"} Jun 10 15:11:05.216621 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.216180 2578 scope.go:117] "RemoveContainer" containerID="a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7" Jun 10 15:11:05.225361 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.225345 2578 scope.go:117] "RemoveContainer" containerID="a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7" Jun 10 15:11:05.225631 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:11:05.225612 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7\": container with ID starting with a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7 not found: ID does not exist" containerID="a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7" Jun 10 15:11:05.225720 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.225635 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7"} err="failed to get container status \"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7\": rpc error: code = NotFound desc = could not find container \"a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7\": container with ID starting with a9eb6c45d3ce58a9ebb7ea20d6efa8c0cc5048822929f8410aab69b78f4530c7 not found: ID does not exist" Jun 10 15:11:05.250409 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.250376 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:11:05.253186 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:05.253160 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5479dd6c56-5bngh"] Jun 10 15:11:06.298264 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:11:06.298229 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f6ca17-f434-47e9-b809-863b5d315f14" path="/var/lib/kubelet/pods/c9f6ca17-f434-47e9-b809-863b5d315f14/volumes" Jun 10 15:12:45.339404 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.339369 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:12:45.339923 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.339587 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" podUID="0efe4a98-1283-4513-9055-94db2308a89e" containerName="manager" containerID="cri-o://32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec" gracePeriod=30 Jun 10 15:12:45.594902 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.594835 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:12:45.685662 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.685621 2578 generic.go:356] "Generic (PLEG): container finished" podID="0efe4a98-1283-4513-9055-94db2308a89e" containerID="32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec" exitCode=0 Jun 10 15:12:45.685662 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.685668 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" Jun 10 15:12:45.685870 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.685666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" event={"ID":"0efe4a98-1283-4513-9055-94db2308a89e","Type":"ContainerDied","Data":"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec"} Jun 10 15:12:45.685870 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.685727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bd48f54b-jfwcb" event={"ID":"0efe4a98-1283-4513-9055-94db2308a89e","Type":"ContainerDied","Data":"4b62a0b1a175e7644e736f830d187c48b10f8beac3f7fdfc3216fef25faf89eb"} Jun 10 15:12:45.685870 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.685749 2578 scope.go:117] "RemoveContainer" containerID="32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec" Jun 10 15:12:45.694023 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.694004 2578 scope.go:117] "RemoveContainer" containerID="32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec" Jun 10 15:12:45.694272 ip-10-0-138-72 kubenswrapper[2578]: E0610 15:12:45.694256 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec\": container with ID starting with 32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec not found: ID does not exist" containerID="32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec" Jun 10 15:12:45.694313 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.694282 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec"} err="failed to get container status \"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec\": rpc error: code = NotFound desc = could not find container \"32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec\": container with ID starting with 32155f322e9c36f720ee7a8d57159e51bf9ef5bbbe79168e8f801b7e810526ec not found: ID does not exist" Jun 10 15:12:45.713795 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.713770 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv2hv\" (UniqueName: \"kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv\") pod \"0efe4a98-1283-4513-9055-94db2308a89e\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " Jun 10 15:12:45.713910 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.713806 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert\") pod \"0efe4a98-1283-4513-9055-94db2308a89e\" (UID: \"0efe4a98-1283-4513-9055-94db2308a89e\") " Jun 10 15:12:45.715859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.715831 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv" (OuterVolumeSpecName: "kube-api-access-zv2hv") pod "0efe4a98-1283-4513-9055-94db2308a89e" (UID: "0efe4a98-1283-4513-9055-94db2308a89e"). InnerVolumeSpecName "kube-api-access-zv2hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:12:45.715859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.715848 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0efe4a98-1283-4513-9055-94db2308a89e" (UID: "0efe4a98-1283-4513-9055-94db2308a89e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:12:45.814596 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.814552 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv2hv\" (UniqueName: \"kubernetes.io/projected/0efe4a98-1283-4513-9055-94db2308a89e-kube-api-access-zv2hv\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:12:45.814596 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:45.814585 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0efe4a98-1283-4513-9055-94db2308a89e-webhook-cert\") on node \"ip-10-0-138-72.ec2.internal\" DevicePath \"\"" Jun 10 15:12:46.020588 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:46.020554 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:12:46.035284 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:46.035253 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55bd48f54b-jfwcb"] Jun 10 15:12:46.298806 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:12:46.298725 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0efe4a98-1283-4513-9055-94db2308a89e" path="/var/lib/kubelet/pods/0efe4a98-1283-4513-9055-94db2308a89e/volumes" Jun 10 15:15:20.335427 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:15:20.335399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:15:20.339066 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:15:20.339044 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:20:20.366405 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:20:20.366371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:20:20.371229 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:20:20.371207 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:25:20.394499 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:25:20.394466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:25:20.400139 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:25:20.400115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:30:20.422999 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:30:20.422967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:30:20.429790 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:30:20.429770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:34:34.706148 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:34.706113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54b78b6dfc-lhzz8_d299904e-c36e-4170-a6f5-b72aa553e39e/authorino/0.log" Jun 10 15:34:40.091569 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:40.091539 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-n9xl7_ac941a5c-cd32-4061-b6b0-6315a3822754/copy-manifests/0.log" Jun 10 15:34:40.100253 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:40.100230 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-n9xl7_ac941a5c-cd32-4061-b6b0-6315a3822754/manager/0.log" Jun 10 15:34:41.657741 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:41.657710 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54b78b6dfc-lhzz8_d299904e-c36e-4170-a6f5-b72aa553e39e/authorino/0.log" Jun 10 15:34:41.999834 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:41.999756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-klr27_f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5/kuadrant-console-plugin/0.log" Jun 10 15:34:43.155648 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:43.155619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668fbbff94-fpcpz_221e64be-b5ae-4646-8377-8c193d733bfd/kube-auth-proxy/0.log" Jun 10 15:34:43.396105 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:43.396073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cbbbm_31042442-d4e5-4653-8147-ed570da4eabb/payload-pre-processing/0.log" Jun 10 15:34:44.096456 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.096423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-x9qgb_5ea0f2e0-a88e-43e9-9545-c3d26e1442de/storage-initializer/0.log" Jun 10 15:34:44.104782 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.104752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-x9qgb_5ea0f2e0-a88e-43e9-9545-c3d26e1442de/main/0.log" Jun 10 15:34:44.467799 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.467721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2_01eeb463-7608-4104-9e83-34f2ea4411f0/storage-initializer/0.log" Jun 10 15:34:44.475926 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.475898 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-rhcs2_01eeb463-7608-4104-9e83-34f2ea4411f0/main/0.log" Jun 10 15:34:44.586474 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.586449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zg7c2_9ab1e7ed-00b0-4ef8-a22b-645fe58a1029/storage-initializer/0.log" Jun 10 15:34:44.593589 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:44.593565 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zg7c2_9ab1e7ed-00b0-4ef8-a22b-645fe58a1029/main/0.log" Jun 10 15:34:52.340542 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:52.340505 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lddgs_b6b43326-1581-499d-b039-fffb047c730a/global-pull-secret-syncer/0.log" Jun 10 15:34:52.526895 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:52.526844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fsfcj_e45815a9-3033-40e0-87fd-ecd0bfdd91f2/konnectivity-agent/0.log" Jun 10 15:34:52.573209 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:52.573174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-72.ec2.internal_4d052639297a2fde41914445a4e994b5/haproxy/0.log" Jun 10 15:34:57.581075 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:57.581040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54b78b6dfc-lhzz8_d299904e-c36e-4170-a6f5-b72aa553e39e/authorino/0.log" Jun 10 15:34:57.682759 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:57.682725 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-klr27_f6ad5d04-45a5-4193-b00e-a8a1fa4a76e5/kuadrant-console-plugin/0.log" Jun 10 15:34:59.609438 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.609413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/alertmanager/0.log" Jun 10 15:34:59.634052 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.634029 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/config-reloader/0.log" Jun 10 15:34:59.665444 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.665420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/kube-rbac-proxy-web/0.log" Jun 10 15:34:59.692641 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.692621 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/kube-rbac-proxy/0.log" Jun 10 15:34:59.713468 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.713446 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/kube-rbac-proxy-metric/0.log" Jun 10 15:34:59.737928 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.737903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/prom-label-proxy/0.log" Jun 10 15:34:59.761686 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.761663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7d82ef8-65ee-4af9-aebe-c31ddecada29/init-config-reloader/0.log" Jun 10 15:34:59.840314 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.840285 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-state-metrics/0.log" Jun 10 15:34:59.864854 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.864779 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-rbac-proxy-main/0.log" Jun 10 15:34:59.896896 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:34:59.896872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-df4t2_e8a42d78-c1c8-484c-965c-5ff14b1b5414/kube-rbac-proxy-self/0.log" Jun 10 15:35:00.095998 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.095971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/node-exporter/0.log" Jun 10 15:35:00.117874 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.117809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/kube-rbac-proxy/0.log" Jun 10 15:35:00.142454 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.142431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8t8r_6c45914d-a1f6-42e7-894a-123012ab5033/init-textfile/0.log" Jun 10 15:35:00.678599 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.678573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/telemeter-client/0.log" Jun 10 15:35:00.708819 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.708790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/reload/0.log" Jun 10 15:35:00.728858 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:00.728833 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c775669b4-dmzrm_dfcd534f-4854-46a6-bb5a-1ab7b2414b7b/kube-rbac-proxy/0.log" Jun 10 15:35:03.770744 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:03.770712 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8567985cdf-kj4t2_baf5b2f3-12a5-4b92-8d94-080595656f08/console/0.log" Jun 10 15:35:03.800986 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:03.800936 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-sjbzs_ee654d00-fba7-4dee-be4c-9a8388eb9811/download-server/0.log" Jun 10 15:35:04.528085 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528053 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm"] Jun 10 15:35:04.528449 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528435 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efe4a98-1283-4513-9055-94db2308a89e" containerName="manager" Jun 10 15:35:04.528490 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528450 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efe4a98-1283-4513-9055-94db2308a89e" containerName="manager" Jun 10 15:35:04.528490 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528472 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f6ca17-f434-47e9-b809-863b5d315f14" containerName="authorino" Jun 10 15:35:04.528490 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528483 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f6ca17-f434-47e9-b809-863b5d315f14" containerName="authorino" Jun 10 15:35:04.528587 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528547 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f6ca17-f434-47e9-b809-863b5d315f14" containerName="authorino" Jun 10 15:35:04.528587 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.528559 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0efe4a98-1283-4513-9055-94db2308a89e" containerName="manager" Jun 10 15:35:04.531658 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.531640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.534186 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.534164 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wflr2\"/\"default-dockercfg-pf6ln\"" Jun 10 15:35:04.534186 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.534167 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wflr2\"/\"kube-root-ca.crt\"" Jun 10 15:35:04.534739 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.534724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wflr2\"/\"openshift-service-ca.crt\"" Jun 10 15:35:04.538812 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.538792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm"] Jun 10 15:35:04.618674 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.618642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-sys\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.618859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.618715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-proc\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.618859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.618762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-lib-modules\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.618859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.618783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-podres\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.618859 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.618810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tffg5\" (UniqueName: \"kubernetes.io/projected/9aa5edda-6338-4664-b1ca-7780750571b1-kube-api-access-tffg5\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719311 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-sys\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719531 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-proc\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719531 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-lib-modules\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719531 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-podres\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719531 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-sys\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719531 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tffg5\" (UniqueName: \"kubernetes.io/projected/9aa5edda-6338-4664-b1ca-7780750571b1-kube-api-access-tffg5\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719760 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-podres\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719760 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-lib-modules\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.719760 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.719476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9aa5edda-6338-4664-b1ca-7780750571b1-proc\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.728117 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.728094 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tffg5\" (UniqueName: \"kubernetes.io/projected/9aa5edda-6338-4664-b1ca-7780750571b1-kube-api-access-tffg5\") pod \"perf-node-gather-daemonset-zpvhm\" (UID: \"9aa5edda-6338-4664-b1ca-7780750571b1\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.842495 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.842462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:04.976055 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:04.976025 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm"] Jun 10 15:35:04.978164 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:35:04.978138 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9aa5edda_6338_4664_b1ca_7780750571b1.slice/crio-7ddbdad148950b398d06957177f10f14e17e87f2db84ba68fc006b7e7844bb98 WatchSource:0}: Error finding container 7ddbdad148950b398d06957177f10f14e17e87f2db84ba68fc006b7e7844bb98: Status 404 returned error can't find the container with id 7ddbdad148950b398d06957177f10f14e17e87f2db84ba68fc006b7e7844bb98 Jun 10 15:35:05.862465 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.862433 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ffw9_a9b156d4-c68a-475d-8e98-361a976522ce/dns/0.log" Jun 10 15:35:05.893369 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.893332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" event={"ID":"9aa5edda-6338-4664-b1ca-7780750571b1","Type":"ContainerStarted","Data":"e704671b82ffeafcef4fb9376e8a8f2393563a462149350559b6b8b48c9a8c61"} Jun 10 15:35:05.893558 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.893419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" event={"ID":"9aa5edda-6338-4664-b1ca-7780750571b1","Type":"ContainerStarted","Data":"7ddbdad148950b398d06957177f10f14e17e87f2db84ba68fc006b7e7844bb98"} Jun 10 15:35:05.893558 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.893342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ffw9_a9b156d4-c68a-475d-8e98-361a976522ce/kube-rbac-proxy/0.log" Jun 10 15:35:05.893558 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.893490 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:05.910203 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:05.910159 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" podStartSLOduration=1.910143803 podStartE2EDuration="1.910143803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:35:05.908772555 +0000 UTC m=+2386.026332269" watchObservedRunningTime="2026-06-10 15:35:05.910143803 +0000 UTC m=+2386.027703532" Jun 10 15:35:06.065197 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:06.065172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-clpwq_93e10899-9138-485b-9224-dd474ba6dc37/dns-node-resolver/0.log" Jun 10 15:35:06.677588 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:06.677563 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fd48d9b75-5h8jc_2b65a7f8-2fcf-4f98-a051-0e1936f86e22/registry/0.log" Jun 10 15:35:06.686347 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:06.686316 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fd48d9b75-5h8jc_2b65a7f8-2fcf-4f98-a051-0e1936f86e22/registry/1.log" Jun 10 15:35:06.734835 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:06.734811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8d6r2_346f4452-02c4-46f3-b06a-51dbf5c43d27/node-ca/0.log" Jun 10 15:35:07.993632 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:07.993603 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668fbbff94-fpcpz_221e64be-b5ae-4646-8377-8c193d733bfd/kube-auth-proxy/0.log" Jun 10 15:35:08.081560 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:08.081498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cbbbm_31042442-d4e5-4653-8147-ed570da4eabb/payload-pre-processing/0.log" Jun 10 15:35:08.807572 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:08.807542 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6m96_6c550c2e-8fbf-4e76-92e2-541218712a72/serve-healthcheck-canary/0.log" Jun 10 15:35:09.454696 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:09.454639 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh7kg_0e157223-5df6-4178-b6b5-a7b4c907585e/kube-rbac-proxy/0.log" Jun 10 15:35:09.478999 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:09.478964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh7kg_0e157223-5df6-4178-b6b5-a7b4c907585e/exporter/0.log" Jun 10 15:35:09.503386 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:09.503359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh7kg_0e157223-5df6-4178-b6b5-a7b4c907585e/extractor/0.log" Jun 10 15:35:11.907838 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:11.907811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-zpvhm" Jun 10 15:35:12.356208 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:12.356177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-n9xl7_ac941a5c-cd32-4061-b6b0-6315a3822754/manager/0.log" Jun 10 15:35:12.377678 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:12.377652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-n9xl7_ac941a5c-cd32-4061-b6b0-6315a3822754/copy-manifests/0.log" Jun 10 15:35:14.264857 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:14.264830 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7776b7cdb6-dsk5r_3291ce80-fe16-4cf3-980c-fba4a5918e5f/manager/0.log" Jun 10 15:35:18.887011 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:18.886984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668fbbff94-fpcpz_221e64be-b5ae-4646-8377-8c193d733bfd/kube-auth-proxy/0.log" Jun 10 15:35:18.966494 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:18.966461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cbbbm_31042442-d4e5-4653-8147-ed570da4eabb/payload-pre-processing/0.log" Jun 10 15:35:19.804436 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.804399 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-599f59d489-lbqs9"] Jun 10 15:35:19.813777 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.813751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.821803 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.821775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599f59d489-lbqs9"] Jun 10 15:35:19.951443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-trusted-ca-bundle\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951443 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-oauth-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951877 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-console-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951877 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-service-ca\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951877 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gljrq\" (UniqueName: \"kubernetes.io/projected/15cea838-8a1e-446e-b0f9-39d160ccd171-kube-api-access-gljrq\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951877 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:19.951877 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:19.951671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-oauth-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052631 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-console-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052631 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-service-ca\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052879 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gljrq\" (UniqueName: \"kubernetes.io/projected/15cea838-8a1e-446e-b0f9-39d160ccd171-kube-api-access-gljrq\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052879 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052879 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-oauth-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052879 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-trusted-ca-bundle\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.052879 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.052790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-oauth-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.053463 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.053438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-service-ca\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.053562 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.053486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-console-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.053562 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.053538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-oauth-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.053740 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.053714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15cea838-8a1e-446e-b0f9-39d160ccd171-trusted-ca-bundle\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.055876 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.055820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-oauth-config\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.055876 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.055820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15cea838-8a1e-446e-b0f9-39d160ccd171-console-serving-cert\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.061685 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.061660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gljrq\" (UniqueName: \"kubernetes.io/projected/15cea838-8a1e-446e-b0f9-39d160ccd171-kube-api-access-gljrq\") pod \"console-599f59d489-lbqs9\" (UID: \"15cea838-8a1e-446e-b0f9-39d160ccd171\") " pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.125475 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.125436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599f59d489-lbqs9" Jun 10 15:35:20.264929 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.264903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668fbbff94-fpcpz_221e64be-b5ae-4646-8377-8c193d733bfd/kube-auth-proxy/0.log" Jun 10 15:35:20.273473 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.273450 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599f59d489-lbqs9"] Jun 10 15:35:20.275793 ip-10-0-138-72 kubenswrapper[2578]: W0610 15:35:20.275760 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cea838_8a1e_446e_b0f9_39d160ccd171.slice/crio-0afc4f7fa4ae0e84ece56b494349abb3dc606ba9dcc3daa17935994587ac963d WatchSource:0}: Error finding container 0afc4f7fa4ae0e84ece56b494349abb3dc606ba9dcc3daa17935994587ac963d: Status 404 returned error can't find the container with id 0afc4f7fa4ae0e84ece56b494349abb3dc606ba9dcc3daa17935994587ac963d Jun 10 15:35:20.346172 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.346148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cbbbm_31042442-d4e5-4653-8147-ed570da4eabb/payload-pre-processing/0.log" Jun 10 15:35:20.454977 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.454856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:35:20.466347 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.460669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4dhk4_e069f58a-7dd2-49b1-821a-623fc7d1344c/ovn-acl-logging/0.log" Jun 10 15:35:20.965499 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.965462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599f59d489-lbqs9" event={"ID":"15cea838-8a1e-446e-b0f9-39d160ccd171","Type":"ContainerStarted","Data":"40ecce186c9b2ec73aa55ef46a7ebe4f5b21d6792bd60dadc83d99edbd7dc5e2"} Jun 10 15:35:20.965878 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.965518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599f59d489-lbqs9" event={"ID":"15cea838-8a1e-446e-b0f9-39d160ccd171","Type":"ContainerStarted","Data":"0afc4f7fa4ae0e84ece56b494349abb3dc606ba9dcc3daa17935994587ac963d"} Jun 10 15:35:20.985679 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:20.985630 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-599f59d489-lbqs9" podStartSLOduration=1.985612325 podStartE2EDuration="1.985612325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:35:20.984543507 +0000 UTC m=+2401.102103230" watchObservedRunningTime="2026-06-10 15:35:20.985612325 +0000 UTC m=+2401.103172049" Jun 10 15:35:21.425050 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.425025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/kube-multus-additional-cni-plugins/0.log" Jun 10 15:35:21.451101 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.451070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/egress-router-binary-copy/0.log" Jun 10 15:35:21.474243 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.474216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/cni-plugins/0.log" Jun 10 15:35:21.500060 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.500035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/bond-cni-plugin/0.log" Jun 10 15:35:21.521897 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.521869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/routeoverride-cni/0.log" Jun 10 15:35:21.546065 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.546040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/whereabouts-cni-bincopy/0.log" Jun 10 15:35:21.567618 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:21.567592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tnqv_ab7d936f-c0b7-4acc-be05-98b108083539/whereabouts-cni/0.log" Jun 10 15:35:22.021996 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:22.021969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfrmz_c80103d3-ad92-442e-a6e9-74e86f297ae3/kube-multus/0.log" Jun 10 15:35:22.147727 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:22.147698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xcj2n_52e8cd09-60f1-4aa3-9f1f-ba90a4141d29/network-metrics-daemon/0.log" Jun 10 15:35:22.166416 ip-10-0-138-72 kubenswrapper[2578]: I0610 15:35:22.166382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xcj2n_52e8cd09-60f1-4aa3-9f1f-ba90a4141d29/kube-rbac-proxy/0.log"