Sep 10 18:31:16.056380 ip-10-0-130-133 systemd[1]: Starting Kubernetes Kubelet... Sep 10 18:31:16.483580 ip-10-0-130-133 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 18:31:16.483580 ip-10-0-130-133 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 18:31:16.483580 ip-10-0-130-133 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 18:31:16.483580 ip-10-0-130-133 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 18:31:16.483580 ip-10-0-130-133 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 18:31:16.486227 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.486125 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 18:31:16.490990 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.490967 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.490990 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.490989 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.490990 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.490992 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.490996 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.490999 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491004 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491007 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491010 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491013 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491016 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491018 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491022 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491025 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491028 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491031 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491033 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491043 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491048 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491051 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491066 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491069 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.491108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491072 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491075 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491078 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491080 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491083 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491087 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491091 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491094 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491097 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491100 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491103 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491106 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491109 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491112 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491115 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491118 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491121 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491124 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491127 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.491599 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491129 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491132 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491134 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491137 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491140 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491142 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491145 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491147 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491150 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491152 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491155 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491157 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491160 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491164 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491166 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491170 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491173 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491176 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491178 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491181 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.492093 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491184 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491188 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491191 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491194 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491197 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491200 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491203 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491207 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491210 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491213 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491216 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491220 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491223 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491226 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491228 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491231 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491233 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491236 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491239 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491241 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.492587 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491244 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491246 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491249 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491251 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491255 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491257 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491261 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491264 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491266 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491269 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491272 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491276 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491278 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491281 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491284 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491287 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491289 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491292 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.491295 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492050 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.493091 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492070 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492075 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492077 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492080 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492084 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492087 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492090 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492092 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492095 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492098 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492101 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492106 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492110 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492113 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492115 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492118 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492121 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492123 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492126 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.493583 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492130 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492133 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492135 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492138 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492141 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492144 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492147 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492149 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492152 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492155 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492157 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492160 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492162 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492166 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492168 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492171 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492173 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492176 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492180 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492182 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.494118 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492185 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492187 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492190 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492193 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492196 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492198 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492200 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492203 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492205 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492208 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492211 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492214 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492217 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492219 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492222 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492224 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492227 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492229 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492232 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492235 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.494625 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492239 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492242 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492244 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492246 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492249 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492252 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492254 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492257 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492259 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492261 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492264 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492267 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492269 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492272 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492274 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492277 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492279 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492283 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492287 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.495146 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492291 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492294 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492298 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492301 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492304 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492307 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492309 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492311 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492314 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492316 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492319 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492321 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492324 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492326 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492329 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492331 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492334 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492336 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492339 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492341 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.495628 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492747 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492752 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492755 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492758 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492761 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492764 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492767 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492769 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492773 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492775 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492778 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492780 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492783 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492785 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492788 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492791 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492794 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492797 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492800 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.496151 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492802 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492805 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492808 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492811 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492813 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492816 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492819 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492822 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492824 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492827 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492829 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492832 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492834 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492837 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492840 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492843 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492845 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492847 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492851 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492853 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.496618 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492856 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492861 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492864 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492866 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492869 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492871 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492874 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492877 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492880 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492883 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492887 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492890 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492892 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492895 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492897 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492900 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492903 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492905 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492908 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492910 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.497130 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492913 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492915 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492918 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492920 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492923 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492927 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492930 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492933 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492936 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492938 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492941 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492944 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492948 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492952 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492954 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492957 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492959 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492962 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492965 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.497617 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492967 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492973 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492975 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492978 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492980 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492983 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492986 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492990 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492993 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492995 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.492998 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493001 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493004 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493007 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493010 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493013 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493016 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493019 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493021 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.498116 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493024 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493154 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493188 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493195 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493199 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493206 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493210 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493214 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493220 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493223 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493226 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493231 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493235 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493238 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493241 2579 flags.go:64] FLAG: --cgroup-root="" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493244 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493247 2579 flags.go:64] FLAG: --client-ca-file="" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493250 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493253 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493258 2579 flags.go:64] FLAG: --cluster-domain="" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493261 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493264 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493268 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493271 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 18:31:16.498612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493275 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493279 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493282 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493285 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493288 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493291 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493294 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493297 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493300 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493304 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493307 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493310 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493313 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493317 2579 flags.go:64] FLAG: --enable-server="true" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493321 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493325 2579 flags.go:64] FLAG: --event-burst="100" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493329 2579 flags.go:64] FLAG: --event-qps="50" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493332 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493335 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493339 2579 flags.go:64] FLAG: --eviction-hard="" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493343 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493346 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493349 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493352 2579 flags.go:64] FLAG: --eviction-soft="" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493355 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 18:31:16.499223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493358 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493361 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493364 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493367 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493370 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493373 2579 flags.go:64] FLAG: --feature-gates="" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493377 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493380 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493383 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493386 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493389 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493392 2579 flags.go:64] FLAG: --help="false" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493395 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493398 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493401 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493404 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493408 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493412 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493415 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493417 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493420 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493424 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493428 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493431 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 18:31:16.499967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493434 2579 flags.go:64] FLAG: --kube-reserved="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493437 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493441 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493444 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493447 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493450 2579 flags.go:64] FLAG: --lock-file="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493453 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493456 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493459 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493464 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493467 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493470 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493473 2579 flags.go:64] FLAG: --logging-format="text" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493476 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493479 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493482 2579 flags.go:64] FLAG: --manifest-url="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493485 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493490 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493493 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493497 2579 flags.go:64] FLAG: --max-pods="110" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493500 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493503 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493506 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493509 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493512 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 18:31:16.500582 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493515 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493518 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493527 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493530 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493534 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493537 2579 flags.go:64] FLAG: --pod-cidr="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493540 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493546 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493548 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493551 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493556 2579 flags.go:64] FLAG: --port="10250" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493559 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493562 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07de37d1c2207092a" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493565 2579 flags.go:64] FLAG: --qos-reserved="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493568 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493571 2579 flags.go:64] FLAG: --register-node="true" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493574 2579 flags.go:64] FLAG: --register-with-taints="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493578 2579 flags.go:64] FLAG: --registry-burst="10" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493581 2579 flags.go:64] FLAG: --registry-qps="5" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493584 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493587 2579 flags.go:64] FLAG: --reserved-memory="" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493591 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493595 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493598 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493601 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 18:31:16.501213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493604 2579 flags.go:64] FLAG: --runonce="false" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493607 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493610 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493613 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493616 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493619 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493622 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493626 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493628 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493631 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493635 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493638 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493641 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493644 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493647 2579 flags.go:64] FLAG: --system-cgroups="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493651 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493657 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493661 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493664 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493668 2579 flags.go:64] FLAG: --tls-min-version="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493671 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493674 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493677 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493680 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493683 2579 flags.go:64] FLAG: --v="2" Sep 10 18:31:16.501822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493687 2579 flags.go:64] FLAG: --version="false" Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493695 2579 flags.go:64] FLAG: --vmodule="" Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493699 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.493702 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493821 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493827 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493831 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493834 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493837 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493840 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493843 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493846 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493848 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493851 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493854 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493858 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493861 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493865 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493868 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.502537 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493871 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493874 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493877 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493880 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493883 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493887 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493890 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493892 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493895 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493898 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493900 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493903 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493905 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493908 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493911 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493913 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493916 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493918 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493921 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493923 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.503014 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493926 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493929 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493931 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493934 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493936 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493939 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493941 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493944 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493946 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493949 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493954 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493957 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493960 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493962 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493965 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493967 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493970 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493974 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493977 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.503553 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493980 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493982 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493985 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493987 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493990 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493992 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493995 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.493997 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494000 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494003 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494005 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494008 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494011 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494014 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494016 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494019 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494022 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494024 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494027 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494029 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.504039 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494032 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494034 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494037 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494043 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494046 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494048 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494051 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494068 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494071 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494074 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494079 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494081 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494085 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494090 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494093 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494097 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494101 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494104 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494107 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494110 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494113 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.504548 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494115 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.505081 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494118 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.505081 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494121 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.505081 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.494124 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.505081 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.494765 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 18:31:16.506481 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.506454 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 18:31:16.506481 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.506480 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 18:31:16.506550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.506500 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 18:31:16.506550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.506507 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506569 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506577 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506582 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506585 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506588 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506591 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506594 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506597 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506600 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506602 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506605 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506608 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506611 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.506608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506614 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506617 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506620 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506622 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506625 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506627 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506630 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506632 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506635 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506639 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506643 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506645 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506648 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506651 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506654 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506657 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506661 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506663 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506666 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.506952 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506669 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506672 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506674 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506677 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506679 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506682 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506685 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506687 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506690 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506693 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506695 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506698 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506701 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506703 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506706 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506709 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506712 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506715 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506718 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506720 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.507512 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506723 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506725 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506728 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506730 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506733 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506735 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506738 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506740 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506743 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506745 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506748 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506751 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506755 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506758 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506761 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506764 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506768 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506771 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506775 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506778 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.508052 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506780 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506783 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506786 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506789 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506791 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506794 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506797 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506800 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506803 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506805 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506808 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506810 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506813 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506815 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506818 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506821 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506823 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506826 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506829 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506831 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.508608 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506833 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506836 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506839 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506842 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506845 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506848 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506851 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.506857 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506976 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506982 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506985 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506988 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506991 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506994 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.506997 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 18:31:16.509183 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507000 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507003 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507005 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507008 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507011 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507015 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507018 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507021 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507023 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507026 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507029 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507031 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507034 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507037 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507040 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507043 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507046 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507049 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507051 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507069 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 10 18:31:16.509709 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507074 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507079 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507082 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507085 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507087 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507090 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507093 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507095 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507098 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507101 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507103 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507106 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507108 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507113 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507116 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507119 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507122 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507126 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507129 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507132 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 18:31:16.510229 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507135 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507138 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507141 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507144 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507147 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507150 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507152 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507155 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507158 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507160 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507163 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507167 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507170 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507174 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507178 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507182 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507184 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507187 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507190 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 18:31:16.510723 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507193 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507195 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507198 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507201 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507204 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507206 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507210 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507214 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507217 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507220 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507223 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507226 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507228 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507231 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507234 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507236 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507239 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507241 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507244 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507246 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 18:31:16.511201 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507249 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507251 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507254 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507257 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507259 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507262 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507265 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507267 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507271 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507273 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507276 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507278 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:16.507281 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.507287 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 18:31:16.511695 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.507435 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 18:31:16.515284 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.515258 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 18:31:16.516260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.516244 2579 server.go:1019] "Starting client certificate rotation" Sep 10 18:31:16.516375 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.516353 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 18:31:16.516426 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.516409 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 18:31:16.519624 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.519599 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 18:31:16.521898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.521874 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 18:31:16.532762 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.532725 2579 log.go:25] "Validated CRI v1 runtime API" Sep 10 18:31:16.536117 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.536095 2579 log.go:25] "Validated CRI v1 image API" Sep 10 18:31:16.537072 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.537037 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 18:31:16.540348 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.540322 2579 fs.go:135] Filesystem UUIDs: map[67c74222-02dd-4d38-9490-ff9f2b8423d8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ab3a028c-fb4d-4f72-a7b1-a3a4aa017035:/dev/nvme0n1p4] Sep 10 18:31:16.540424 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.540344 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 18:31:16.545611 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.545496 2579 manager.go:216] Machine: {Timestamp:2026-09-10 18:31:16.544092221 +0000 UTC m=+0.377407786 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111582 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2464c30622403526937b55c124809a SystemUUID:ec2464c3-0622-4035-2693-7b55c124809a BootID:9ef97c02-54ab-4e00-a24c-c4f56ea3a34e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:f8:65:e3:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:f8:65:e3:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:93:d4:b8:c5:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 18:31:16.545611 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.545604 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 18:31:16.545724 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.545694 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 18:31:16.546022 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.546004 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 18:31:16.549252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.549216 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 18:31:16.549396 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.549255 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 18:31:16.550828 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.550814 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 18:31:16.550828 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.550828 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 18:31:16.550896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.550836 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 18:31:16.551679 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.551666 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 18:31:16.552979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.552966 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 18:31:16.557473 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557459 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 10 18:31:16.557595 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557586 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 18:31:16.557626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557615 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 10 18:31:16.557626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557625 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 18:31:16.557680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557643 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 18:31:16.557680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557659 2579 kubelet.go:398] "Adding apiserver pod source" Sep 10 18:31:16.557680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.557671 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 18:31:16.558086 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.558050 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 18:31:16.558128 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.558122 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 18:31:16.562120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.562087 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 18:31:16.565011 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.564996 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 18:31:16.565076 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565029 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 18:31:16.565225 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565215 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 18:31:16.565260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565230 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 18:31:16.565260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565236 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 18:31:16.565260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565241 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 18:31:16.565260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565248 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 18:31:16.565260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565253 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 18:31:16.565867 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565857 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 18:31:16.565898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565867 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 18:31:16.565898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565874 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 18:31:16.565898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565881 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 18:31:16.565898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565889 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 18:31:16.565898 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.565896 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 18:31:16.566718 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.566708 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 18:31:16.566718 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.566717 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 18:31:16.569279 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.569254 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 18:31:16.569386 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.569370 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 18:31:16.569439 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.569379 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 18:31:16.570982 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.570969 2579 server.go:1268] "Started kubelet" Sep 10 18:31:16.571104 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.571077 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 18:31:16.571104 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.571050 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 18:31:16.571182 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.571140 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 18:31:16.571774 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.571747 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bflfk" Sep 10 18:31:16.572073 ip-10-0-130-133 systemd[1]: Started Kubernetes Kubelet. Sep 10 18:31:16.572627 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.572607 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 18:31:16.572971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.572955 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 10 18:31:16.575768 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.575750 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 18:31:16.577839 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.577822 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 18:31:16.577839 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.577831 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 18:31:16.577990 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.577968 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bflfk" Sep 10 18:31:16.578265 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.578126 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.578626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.578602 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 18:31:16.578700 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.578629 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 18:31:16.578749 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.578701 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 18:31:16.578867 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.578792 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 10 18:31:16.578867 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.578803 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 10 18:31:16.579615 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579595 2579 factory.go:55] Registering systemd factory Sep 10 18:31:16.579615 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579616 2579 factory.go:223] Registration of the systemd container factory successfully Sep 10 18:31:16.579857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579843 2579 factory.go:153] Registering CRI-O factory Sep 10 18:31:16.579857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579859 2579 factory.go:223] Registration of the crio container factory successfully Sep 10 18:31:16.579935 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579911 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 18:31:16.579935 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579927 2579 factory.go:103] Registering Raw factory Sep 10 18:31:16.580032 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.579937 2579 manager.go:1196] Started watching for new ooms in manager Sep 10 18:31:16.580353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.580336 2579 manager.go:349] Starting recovery of all containers Sep 10 18:31:16.584736 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.584702 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 18:31:16.584887 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.584864 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 18:31:16.585969 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.584737 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-133.ec2.internal.18d409355111518d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-133.ec2.internal,UID:ip-10-0-130-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-133.ec2.internal,},FirstTimestamp:2026-09-10 18:31:16.570935693 +0000 UTC m=+0.404251257,LastTimestamp:2026-09-10 18:31:16.570935693 +0000 UTC m=+0.404251257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-133.ec2.internal,}" Sep 10 18:31:16.593233 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.592991 2579 manager.go:354] Recovery completed Sep 10 18:31:16.600441 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.600426 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.602340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.602320 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.602447 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.602355 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.602447 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.602366 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.603016 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.602999 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 18:31:16.603016 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.603015 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 18:31:16.603151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.603028 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.603151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.603036 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 10 18:31:16.603981 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.603963 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.604078 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.604003 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.604078 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.604018 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.605232 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.605220 2579 policy_none.go:49] "None policy: Start" Sep 10 18:31:16.605288 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.605239 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 18:31:16.605288 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.605252 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 18:31:16.607308 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.607295 2579 policy_none.go:47] "Start" Sep 10 18:31:16.643742 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.643720 2579 manager.go:337] "Starting Device Plugin manager" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.643770 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.643784 2579 server.go:87] "Starting device plugin registration server" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.644226 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.644239 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.644339 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.644424 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.644435 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.644988 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 18:31:16.662581 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.645044 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.688473 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.688425 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 18:31:16.689672 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.689650 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 18:31:16.689795 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.689703 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 18:31:16.689795 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.689748 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 18:31:16.689885 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.689851 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 18:31:16.691638 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.691616 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:16.744425 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.744326 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.745374 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.745353 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.745503 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.745389 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.745503 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.745403 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.745503 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.745432 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.752831 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.752808 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.752927 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.752835 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-133.ec2.internal\": node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.767178 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.767156 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.790518 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.790487 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal"] Sep 10 18:31:16.790661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.790575 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.791692 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.791674 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.791803 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.791704 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.791803 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.791717 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.794137 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794123 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.794308 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.794361 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794323 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.794957 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794939 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.795038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794964 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.795038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794972 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.795038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794984 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.795038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794986 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.795038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.794996 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.797282 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.797269 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.797345 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.797300 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 18:31:16.798487 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.798471 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Sep 10 18:31:16.798573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.798498 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 18:31:16.798573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.798507 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Sep 10 18:31:16.824814 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.824782 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-133.ec2.internal\" not found" node="ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.829257 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.829238 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-133.ec2.internal\" not found" node="ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.868224 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.868192 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.968757 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:16.968723 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:16.980060 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.980034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.980126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.980085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:16.980126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:16.980109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f9cfc38a9d54d6881403da441b0a834-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"6f9cfc38a9d54d6881403da441b0a834\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.069744 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.069700 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:17.080885 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.080978 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.080978 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f9cfc38a9d54d6881403da441b0a834-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"6f9cfc38a9d54d6881403da441b0a834\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.080978 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f9cfc38a9d54d6881403da441b0a834-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"6f9cfc38a9d54d6881403da441b0a834\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.081122 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.081122 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.080974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dff361b9784023f163739c4d30ad35d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"1dff361b9784023f163739c4d30ad35d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.129731 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.129680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.132090 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.132055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.170685 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.170650 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:17.277962 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.277851 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:17.385308 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.385272 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Sep 10 18:31:17.401299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.401266 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:17.417983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.417949 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:17.479175 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.479141 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.489144 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.489105 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 18:31:17.490730 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.490715 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Sep 10 18:31:17.500043 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.500026 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 18:31:17.516411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.516378 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 18:31:17.516550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.516532 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 18:31:17.516595 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.516572 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 18:31:17.516631 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.516572 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 18:31:17.559448 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.559371 2579 apiserver.go:52] "Watching apiserver" Sep 10 18:31:17.578964 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.578936 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 18:31:17.579131 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.578989 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 18:31:17.579550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.579527 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-r29np","kube-system/global-pull-secret-syncer-22lxr","kube-system/konnectivity-agent-kxzql","openshift-cluster-node-tuning-operator/tuned-4c4ft","openshift-dns/node-resolver-9d7bm","openshift-network-operator/iptables-alerter-xlvff","openshift-ovn-kubernetes/ovnkube-node-hhz7s","kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl","openshift-image-registry/node-ca-f8rtw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal","openshift-multus/multus-9cl5z","openshift-multus/multus-additional-cni-plugins-jhwrm","openshift-multus/network-metrics-daemon-rh4jl"] Sep 10 18:31:17.582284 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.582261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.585272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.584821 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 18:26:17 +0000 UTC" deadline="2028-04-04 18:16:30.515742121 +0000 UTC" Sep 10 18:31:17.585272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.584886 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13727h45m12.930867573s" Sep 10 18:31:17.585272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.585080 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 18:31:17.585272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.585108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5qkpr\"" Sep 10 18:31:17.585272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.585143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.585573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.585471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.585717 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.585695 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.586754 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.586732 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 18:31:17.586855 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.586823 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 18:31:17.586917 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.586903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 18:31:17.587695 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.587673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.589126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.589126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r9zwv\"" Sep 10 18:31:17.589294 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589161 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 18:31:17.589294 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589167 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.589294 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589246 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 18:31:17.589435 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.589341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 18:31:17.590272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.590255 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 18:31:17.590599 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.590577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 18:31:17.590684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.590585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cxsx9\"" Sep 10 18:31:17.591227 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.591209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.592860 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.592834 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 18:31:17.593789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.593769 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.594018 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.594001 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.594104 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.594002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2hdg\"" Sep 10 18:31:17.594213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.594196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.596640 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.596621 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6fc2f\"" Sep 10 18:31:17.596877 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.596858 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.596877 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.596875 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.597149 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.597128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.599774 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.599754 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.599903 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.599774 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.599903 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.599794 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 18:31:17.600051 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.600036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wnxd8\"" Sep 10 18:31:17.600136 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.600120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.602578 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.602560 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 18:31:17.602872 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.602857 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.603050 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.603037 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.603237 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.603223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:17.603312 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.603292 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:17.603669 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.603655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fz55j\"" Sep 10 18:31:17.605892 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.605875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.605980 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.605935 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:17.608727 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.608701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.611275 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.611254 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 18:31:17.611390 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.611370 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sqmnq\"" Sep 10 18:31:17.611476 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.611422 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 18:31:17.611567 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.611520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 18:31:17.611827 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.611809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.611914 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.611864 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:17.614665 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.614647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.615974 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.615957 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:17.619127 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.617612 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 18:31:17.619127 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.617614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z6k6k\"" Sep 10 18:31:17.621121 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.621099 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-896zj" Sep 10 18:31:17.632248 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.632230 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-896zj" Sep 10 18:31:17.680214 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.680186 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 18:31:17.686675 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.686675 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b396a88f-79df-4aa7-a136-19146def7c13-hosts-file\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckl94\" (UniqueName: \"kubernetes.io/projected/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-kube-api-access-ckl94\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-config\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-run\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cnibin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cni-binary-copy\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-systemd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.686873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7bh\" (UniqueName: \"kubernetes.io/projected/b5384087-b807-40a4-a982-6ca6df7050bd-kube-api-access-pg7bh\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-host\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdfb\" (UniqueName: \"kubernetes.io/projected/b396a88f-79df-4aa7-a136-19146def7c13-kube-api-access-dbdfb\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-host\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.686954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea401532-b33e-41c2-af7d-0561b3fa8c9b-iptables-alerter-script\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-dbus\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-script-lib\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-device-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-daemon-config\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-var-lib-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-env-overrides\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-agent-certs\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-konnectivity-ca\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-systemd\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.687391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-multus-certs\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-log-socket\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-tmp\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea401532-b33e-41c2-af7d-0561b3fa8c9b-host-slash\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/ea401532-b33e-41c2-af7d-0561b3fa8c9b-kube-api-access-lrl6r\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-netns\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-bin\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5384087-b807-40a4-a982-6ca6df7050bd-ovn-node-metrics-cert\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfq68\" (UniqueName: \"kubernetes.io/projected/8a1744af-af41-4f82-a5d6-210344b45a3b-kube-api-access-hfq68\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-conf\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-hostroot\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-netd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5sb4\" (UniqueName: \"kubernetes.io/projected/49b2af53-962d-4d9d-821f-7cb0a24f0150-kube-api-access-f5sb4\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b396a88f-79df-4aa7-a136-19146def7c13-tmp-dir\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.688201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-slash\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-lib-modules\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-ovn\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.687966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-cnibin\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-multus\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysconfig\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-var-lib-kubelet\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-tuned\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-registration-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-kubernetes\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-kubelet-config\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-sys-fs\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-system-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-kubelet\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.688896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-kubelet\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-node-log\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-serviceca\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgl5\" (UniqueName: \"kubernetes.io/projected/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-kube-api-access-4lgl5\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-bin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-etc-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-sys\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-modprobe-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-socket-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.689521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-kube-api-access-wflhj\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-socket-dir-parent\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-etc-kubernetes\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-systemd-units\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9fg\" (UniqueName: \"kubernetes.io/projected/38adc0fb-1a54-4838-b8fd-65a2444021e6-kube-api-access-pg9fg\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-k8s-cni-cncf-io\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-netns\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.690240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.688965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-conf-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.771011 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.770967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9cfc38a9d54d6881403da441b0a834.slice/crio-51bca44b9c0764c540a4bd1ce00361213d5e3b6890b2829dc3455edf3b1526a8 WatchSource:0}: Error finding container 51bca44b9c0764c540a4bd1ce00361213d5e3b6890b2829dc3455edf3b1526a8: Status 404 returned error can't find the container with id 51bca44b9c0764c540a4bd1ce00361213d5e3b6890b2829dc3455edf3b1526a8 Sep 10 18:31:17.778707 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.778683 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 18:31:17.782799 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.782776 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dff361b9784023f163739c4d30ad35d.slice/crio-a391cd21f3fc8b86a6dc9e3708686f0e77b2a3829889d2e95f33a1987bf19f52 WatchSource:0}: Error finding container a391cd21f3fc8b86a6dc9e3708686f0e77b2a3829889d2e95f33a1987bf19f52: Status 404 returned error can't find the container with id a391cd21f3fc8b86a6dc9e3708686f0e77b2a3829889d2e95f33a1987bf19f52 Sep 10 18:31:17.789575 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-lib-modules\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-ovn\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.789646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-cnibin\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.789646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.789746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-multus\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.789746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-ovn\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.789746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysconfig\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789705 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-cnibin\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.789746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-var-lib-kubelet\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-multus\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-tuned\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysconfig\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-registration-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.789768 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-var-lib-kubelet\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-lib-modules\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-kubernetes\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-registration-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.789899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-kubelet-config\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.790276 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-sys-fs\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.790276 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789919 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-kubernetes\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.790276 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.789924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-system-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.790450 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-system-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.790450 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-kubelet\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.790450 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-kubelet\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.790593 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-sys-fs\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.790593 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-kubelet\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.790593 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.790551 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:18.290445303 +0000 UTC m=+2.123760872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:17.790763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-kubelet\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.790763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-kubelet-config\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.790763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-node-log\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.790971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.790971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-node-log\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.790971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-serviceca\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.790971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.790971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgl5\" (UniqueName: \"kubernetes.io/projected/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-kube-api-access-4lgl5\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.790982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-bin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-etc-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791188 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 18:31:17.791252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-sys\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-modprobe-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791373 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-serviceca\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-socket-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-kube-api-access-wflhj\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-socket-dir-parent\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-etc-kubernetes\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-var-lib-cni-bin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-systemd-units\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791588 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-etc-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9fg\" (UniqueName: \"kubernetes.io/projected/38adc0fb-1a54-4838-b8fd-65a2444021e6-kube-api-access-pg9fg\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.791661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-k8s-cni-cncf-io\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-netns\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-conf-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b396a88f-79df-4aa7-a136-19146def7c13-hosts-file\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckl94\" (UniqueName: \"kubernetes.io/projected/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-kube-api-access-ckl94\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-config\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-run\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cnibin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cni-binary-copy\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.791979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-systemd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7bh\" (UniqueName: \"kubernetes.io/projected/b5384087-b807-40a4-a982-6ca6df7050bd-kube-api-access-pg7bh\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-host\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdfb\" (UniqueName: \"kubernetes.io/projected/b396a88f-79df-4aa7-a136-19146def7c13-kube-api-access-dbdfb\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-host\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea401532-b33e-41c2-af7d-0561b3fa8c9b-iptables-alerter-script\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-dbus\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.792363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-script-lib\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-device-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-sys\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-daemon-config\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-var-lib-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.792992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a1744af-af41-4f82-a5d6-210344b45a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-env-overrides\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-modprobe-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-agent-certs\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.793281 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-konnectivity-ca\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-socket-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-systemd\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793376 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-systemd\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-multus-certs\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-systemd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-log-socket\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-tmp\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea401532-b33e-41c2-af7d-0561b3fa8c9b-host-slash\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/ea401532-b33e-41c2-af7d-0561b3fa8c9b-kube-api-access-lrl6r\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-netns\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-bin\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5384087-b807-40a4-a982-6ca6df7050bd-ovn-node-metrics-cert\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfq68\" (UniqueName: \"kubernetes.io/projected/8a1744af-af41-4f82-a5d6-210344b45a3b-kube-api-access-hfq68\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-conf\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cni-binary-copy\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-hostroot\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.793998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-netd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-host\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5sb4\" (UniqueName: \"kubernetes.io/projected/49b2af53-962d-4d9d-821f-7cb0a24f0150-kube-api-access-f5sb4\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-d\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b396a88f-79df-4aa7-a136-19146def7c13-tmp-dir\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-slash\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea401532-b33e-41c2-af7d-0561b3fa8c9b-iptables-alerter-script\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-dbus\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a1744af-af41-4f82-a5d6-210344b45a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-run-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794868 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-socket-dir-parent\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.794918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.794905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-cnibin\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-etc-kubernetes\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-log-socket\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-config\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b396a88f-79df-4aa7-a136-19146def7c13-tmp-dir\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-cni-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-netns\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.795773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796226 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-k8s-cni-cncf-io\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.796226 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-ovnkube-script-lib\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796226 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-tuned\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.796389 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-run-netns\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796458 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea401532-b33e-41c2-af7d-0561b3fa8c9b-host-slash\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.796458 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-bin\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796458 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.793654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-host\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.796684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796554 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-slash\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-conf-dir\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.796684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.795468 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-run\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.796684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b396a88f-79df-4aa7-a136-19146def7c13-hosts-file\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.796684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.796622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-systemd-units\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.796948 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.796800 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:17.797062 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.797041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:18.296986441 +0000 UTC m=+2.130302011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:17.797248 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797201 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-host-run-multus-certs\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.797331 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-var-lib-openvswitch\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.797462 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-multus-daemon-config\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.797462 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/38adc0fb-1a54-4838-b8fd-65a2444021e6-device-dir\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.797590 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-hostroot\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.797866 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49b2af53-962d-4d9d-821f-7cb0a24f0150-etc-sysctl-conf\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.797988 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.797867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.798092 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.798068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5384087-b807-40a4-a982-6ca6df7050bd-host-cni-netd\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.798254 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.798222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5384087-b807-40a4-a982-6ca6df7050bd-env-overrides\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.799038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.798997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-konnectivity-ca\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.799803 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.799784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2af53-962d-4d9d-821f-7cb0a24f0150-tmp\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.800154 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.800116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5384087-b807-40a4-a982-6ca6df7050bd-ovn-node-metrics-cert\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.800969 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.800946 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c6706f9-b195-4f6d-9a6a-375dd10c75f4-agent-certs\") pod \"konnectivity-agent-kxzql\" (UID: \"9c6706f9-b195-4f6d-9a6a-375dd10c75f4\") " pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.801311 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.801292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9fg\" (UniqueName: \"kubernetes.io/projected/38adc0fb-1a54-4838-b8fd-65a2444021e6-kube-api-access-pg9fg\") pod \"aws-ebs-csi-driver-node-n89wl\" (UID: \"38adc0fb-1a54-4838-b8fd-65a2444021e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:17.805550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.805523 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7bh\" (UniqueName: \"kubernetes.io/projected/b5384087-b807-40a4-a982-6ca6df7050bd-kube-api-access-pg7bh\") pod \"ovnkube-node-hhz7s\" (UID: \"b5384087-b807-40a4-a982-6ca6df7050bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.805736 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.805715 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:17.805806 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.805744 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:17.805806 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.805758 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:17.805918 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:17.805841 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:18.305822531 +0000 UTC m=+2.139138089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:17.805918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.805857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgl5\" (UniqueName: \"kubernetes.io/projected/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-kube-api-access-4lgl5\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:17.805918 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.805874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/ea401532-b33e-41c2-af7d-0561b3fa8c9b-kube-api-access-lrl6r\") pod \"iptables-alerter-xlvff\" (UID: \"ea401532-b33e-41c2-af7d-0561b3fa8c9b\") " pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:17.806816 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.806791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5sb4\" (UniqueName: \"kubernetes.io/projected/49b2af53-962d-4d9d-821f-7cb0a24f0150-kube-api-access-f5sb4\") pod \"tuned-4c4ft\" (UID: \"49b2af53-962d-4d9d-821f-7cb0a24f0150\") " pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.807481 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.807455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/5dbfad1a-734c-497e-bd8b-fa4326c5d24a-kube-api-access-wflhj\") pod \"node-ca-f8rtw\" (UID: \"5dbfad1a-734c-497e-bd8b-fa4326c5d24a\") " pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:17.807563 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.807499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdfb\" (UniqueName: \"kubernetes.io/projected/b396a88f-79df-4aa7-a136-19146def7c13-kube-api-access-dbdfb\") pod \"node-resolver-9d7bm\" (UID: \"b396a88f-79df-4aa7-a136-19146def7c13\") " pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.807706 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.807688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfq68\" (UniqueName: \"kubernetes.io/projected/8a1744af-af41-4f82-a5d6-210344b45a3b-kube-api-access-hfq68\") pod \"multus-additional-cni-plugins-jhwrm\" (UID: \"8a1744af-af41-4f82-a5d6-210344b45a3b\") " pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.807706 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.807695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckl94\" (UniqueName: \"kubernetes.io/projected/5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a-kube-api-access-ckl94\") pod \"multus-9cl5z\" (UID: \"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a\") " pod="openshift-multus/multus-9cl5z" Sep 10 18:31:17.917359 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.917256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:17.929436 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.929406 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5384087_b807_40a4_a982_6ca6df7050bd.slice/crio-1790167857d4a8a5302900faaaa287bf62e17a0838545e24224aca47d3fc8022 WatchSource:0}: Error finding container 1790167857d4a8a5302900faaaa287bf62e17a0838545e24224aca47d3fc8022: Status 404 returned error can't find the container with id 1790167857d4a8a5302900faaaa287bf62e17a0838545e24224aca47d3fc8022 Sep 10 18:31:17.929937 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.929908 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" Sep 10 18:31:17.939921 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.939895 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1744af_af41_4f82_a5d6_210344b45a3b.slice/crio-41a8fba1d73c8b52fbd3cee484e422f3dacdef31456d6211c4eb410bd5fb8c76 WatchSource:0}: Error finding container 41a8fba1d73c8b52fbd3cee484e422f3dacdef31456d6211c4eb410bd5fb8c76: Status 404 returned error can't find the container with id 41a8fba1d73c8b52fbd3cee484e422f3dacdef31456d6211c4eb410bd5fb8c76 Sep 10 18:31:17.948160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.948135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:17.957645 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.957620 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6706f9_b195_4f6d_9a6a_375dd10c75f4.slice/crio-5bca7d4df1eb959fc68106faca4c6f4665e01e39b7a49ff3c48a399926b9191a WatchSource:0}: Error finding container 5bca7d4df1eb959fc68106faca4c6f4665e01e39b7a49ff3c48a399926b9191a: Status 404 returned error can't find the container with id 5bca7d4df1eb959fc68106faca4c6f4665e01e39b7a49ff3c48a399926b9191a Sep 10 18:31:17.965752 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.965731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" Sep 10 18:31:17.974148 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.974110 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b2af53_962d_4d9d_821f_7cb0a24f0150.slice/crio-68066d92e69abee99972d8722bdf37471cfc0779ba46118b34539df2b42bf5a4 WatchSource:0}: Error finding container 68066d92e69abee99972d8722bdf37471cfc0779ba46118b34539df2b42bf5a4: Status 404 returned error can't find the container with id 68066d92e69abee99972d8722bdf37471cfc0779ba46118b34539df2b42bf5a4 Sep 10 18:31:17.989677 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:17.989648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9d7bm" Sep 10 18:31:17.998762 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:17.998734 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb396a88f_79df_4aa7_a136_19146def7c13.slice/crio-cb860822b3f34de477bda08506f0321809ca207c3d532e67e098f65ba5a44404 WatchSource:0}: Error finding container cb860822b3f34de477bda08506f0321809ca207c3d532e67e098f65ba5a44404: Status 404 returned error can't find the container with id cb860822b3f34de477bda08506f0321809ca207c3d532e67e098f65ba5a44404 Sep 10 18:31:18.004181 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.004157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xlvff" Sep 10 18:31:18.013291 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:18.013091 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea401532_b33e_41c2_af7d_0561b3fa8c9b.slice/crio-3387aaa226dad35cd3876785077b79df14f504818915b029efc93e04c547aa89 WatchSource:0}: Error finding container 3387aaa226dad35cd3876785077b79df14f504818915b029efc93e04c547aa89: Status 404 returned error can't find the container with id 3387aaa226dad35cd3876785077b79df14f504818915b029efc93e04c547aa89 Sep 10 18:31:18.018789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.018769 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" Sep 10 18:31:18.027383 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:18.027354 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38adc0fb_1a54_4838_b8fd_65a2444021e6.slice/crio-45233fdb2169a25b8472ecca5d734db5fa2edf0f464a68fde7ebe2da66c01efa WatchSource:0}: Error finding container 45233fdb2169a25b8472ecca5d734db5fa2edf0f464a68fde7ebe2da66c01efa: Status 404 returned error can't find the container with id 45233fdb2169a25b8472ecca5d734db5fa2edf0f464a68fde7ebe2da66c01efa Sep 10 18:31:18.032962 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.032944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f8rtw" Sep 10 18:31:18.038267 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.038243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9cl5z" Sep 10 18:31:18.042001 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:18.041978 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbfad1a_734c_497e_bd8b_fa4326c5d24a.slice/crio-c050371c34be410aec90d47857309a90dd3fb2ee8a39c479456d83d6c6291674 WatchSource:0}: Error finding container c050371c34be410aec90d47857309a90dd3fb2ee8a39c479456d83d6c6291674: Status 404 returned error can't find the container with id c050371c34be410aec90d47857309a90dd3fb2ee8a39c479456d83d6c6291674 Sep 10 18:31:18.047367 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:18.047317 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5aaf21_3227_4944_8ac7_5a6c45ac6c2a.slice/crio-cf07465f43aabac0d0cf0626d7bfd6e804ccc95ad161bf0b0382242d5ad800c6 WatchSource:0}: Error finding container cf07465f43aabac0d0cf0626d7bfd6e804ccc95ad161bf0b0382242d5ad800c6: Status 404 returned error can't find the container with id cf07465f43aabac0d0cf0626d7bfd6e804ccc95ad161bf0b0382242d5ad800c6 Sep 10 18:31:18.298786 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.298690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:18.298786 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.298773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:18.299057 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.298890 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:18.299057 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.298980 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:19.298959254 +0000 UTC m=+3.132274813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:18.299057 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.298897 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:18.299057 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.299049 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:19.299033047 +0000 UTC m=+3.132348606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:18.400036 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.399991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:18.400248 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.400222 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:18.400291 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.400260 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:18.400291 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.400278 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:18.400364 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:18.400354 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:19.400332297 +0000 UTC m=+3.233647872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:18.635345 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.635238 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 18:26:18 +0000 UTC" deadline="2028-04-07 23:40:52.556158201 +0000 UTC" Sep 10 18:31:18.635345 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.635290 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13805h9m33.920873151s" Sep 10 18:31:18.722721 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.722638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" event={"ID":"38adc0fb-1a54-4838-b8fd-65a2444021e6","Type":"ContainerStarted","Data":"45233fdb2169a25b8472ecca5d734db5fa2edf0f464a68fde7ebe2da66c01efa"} Sep 10 18:31:18.740087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.740028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xlvff" event={"ID":"ea401532-b33e-41c2-af7d-0561b3fa8c9b","Type":"ContainerStarted","Data":"3387aaa226dad35cd3876785077b79df14f504818915b029efc93e04c547aa89"} Sep 10 18:31:18.762579 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.762533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" event={"ID":"49b2af53-962d-4d9d-821f-7cb0a24f0150","Type":"ContainerStarted","Data":"68066d92e69abee99972d8722bdf37471cfc0779ba46118b34539df2b42bf5a4"} Sep 10 18:31:18.785911 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.785869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxzql" event={"ID":"9c6706f9-b195-4f6d-9a6a-375dd10c75f4","Type":"ContainerStarted","Data":"5bca7d4df1eb959fc68106faca4c6f4665e01e39b7a49ff3c48a399926b9191a"} Sep 10 18:31:18.800341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.800301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"1790167857d4a8a5302900faaaa287bf62e17a0838545e24224aca47d3fc8022"} Sep 10 18:31:18.820463 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.820418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" event={"ID":"6f9cfc38a9d54d6881403da441b0a834","Type":"ContainerStarted","Data":"51bca44b9c0764c540a4bd1ce00361213d5e3b6890b2829dc3455edf3b1526a8"} Sep 10 18:31:18.839883 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.839827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9cl5z" event={"ID":"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a","Type":"ContainerStarted","Data":"cf07465f43aabac0d0cf0626d7bfd6e804ccc95ad161bf0b0382242d5ad800c6"} Sep 10 18:31:18.859469 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.859428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9d7bm" event={"ID":"b396a88f-79df-4aa7-a136-19146def7c13","Type":"ContainerStarted","Data":"cb860822b3f34de477bda08506f0321809ca207c3d532e67e098f65ba5a44404"} Sep 10 18:31:18.883616 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.883568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerStarted","Data":"41a8fba1d73c8b52fbd3cee484e422f3dacdef31456d6211c4eb410bd5fb8c76"} Sep 10 18:31:18.899511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.899426 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:18.920382 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.920342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"1dff361b9784023f163739c4d30ad35d","Type":"ContainerStarted","Data":"a391cd21f3fc8b86a6dc9e3708686f0e77b2a3829889d2e95f33a1987bf19f52"} Sep 10 18:31:18.927848 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:18.927804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f8rtw" event={"ID":"5dbfad1a-734c-497e-bd8b-fa4326c5d24a","Type":"ContainerStarted","Data":"c050371c34be410aec90d47857309a90dd3fb2ee8a39c479456d83d6c6291674"} Sep 10 18:31:19.310099 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.309997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:19.310294 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.310101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:19.310294 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.310256 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:19.310488 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.310336 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:21.310299604 +0000 UTC m=+5.143615160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:19.310784 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.310763 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:19.310861 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.310823 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:21.310807631 +0000 UTC m=+5.144123190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:19.410511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.410474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:19.410705 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.410672 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:19.410705 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.410702 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:19.410828 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.410717 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:19.410828 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.410785 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:21.410765604 +0000 UTC m=+5.244081174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:19.639255 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.636560 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 18:26:18 +0000 UTC" deadline="2028-03-08 23:52:01.516616629 +0000 UTC" Sep 10 18:31:19.639255 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.636625 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13085h20m41.879998477s" Sep 10 18:31:19.690431 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.690393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:19.690638 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.690551 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:19.690719 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.690643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:19.690774 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.690730 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:19.690828 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:19.690800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:19.690934 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:19.690910 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:20.009966 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:20.009865 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:20.159544 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:20.159295 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 18:31:21.327337 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.327290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:21.327844 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.327378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:21.327844 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.327509 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:21.327844 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.327583 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:21.327844 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.327601 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:25.327577292 +0000 UTC m=+9.160892863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:21.327844 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.327647 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:25.327629308 +0000 UTC m=+9.160944867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:21.428636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.428587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:21.428842 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.428828 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:21.428925 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.428864 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:21.428925 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.428879 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:21.429022 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.428944 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:25.428924291 +0000 UTC m=+9.262239861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:21.690620 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.690519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:21.690817 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.690772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:21.690933 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.690914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:21.691033 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.691012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:21.691100 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:21.691086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:21.691783 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:21.691244 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:23.690762 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:23.690726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:23.691330 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:23.690891 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:23.691330 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:23.691303 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:23.691462 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:23.691412 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:23.691526 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:23.691460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:23.691592 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:23.691529 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:25.369147 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.369093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:25.369656 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.369207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:25.369656 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.369260 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:25.369656 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.369328 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:25.369656 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.369350 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:33.369326742 +0000 UTC m=+17.202642299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:25.369656 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.369399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:33.369379815 +0000 UTC m=+17.202695376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:25.470170 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.470126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:25.470372 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.470357 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:25.470458 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.470385 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:25.470458 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.470400 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:25.470560 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.470471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:33.470450346 +0000 UTC m=+17.303765902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.691054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.691241 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.691294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.691407 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:25.691481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:25.691672 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:25.691558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:27.690411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:27.690353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:27.690411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:27.690392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:27.691173 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:27.690392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:27.691173 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:27.690528 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:27.691173 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:27.690674 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:27.691173 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:27.690770 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:29.690669 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:29.690633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:29.691124 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:29.690633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:29.691124 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:29.690764 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:29.691124 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:29.690633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:29.691124 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:29.690839 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:29.691124 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:29.690921 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:31.690815 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:31.690778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:31.691248 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:31.690777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:31.691248 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:31.690897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:31.691248 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:31.690778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:31.691248 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:31.691025 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:31.691248 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:31.691125 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:33.434995 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.434957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:33.435507 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.435038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:33.435507 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.435142 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:33.435507 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.435183 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:33.435507 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.435213 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:31:49.43519711 +0000 UTC m=+33.268512665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:33.435507 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.435231 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:49.435219019 +0000 UTC m=+33.268534570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:33.535801 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.535745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:33.535977 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.535953 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:33.536021 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.535988 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:33.536021 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.536003 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:33.536130 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.536072 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:31:49.536041788 +0000 UTC m=+33.369357340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:33.690514 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.690421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:33.690514 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.690441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:33.690716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:33.690421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:33.690716 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.690548 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:33.690716 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.690627 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:33.690716 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:33.690703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:35.690306 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:35.690278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:35.690306 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:35.690300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:35.690306 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:35.690278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:35.690992 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:35.690410 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:35.690992 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:35.690464 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:35.690992 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:35.690549 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:37.689954 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:37.689923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:37.689954 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:37.689951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:37.690429 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:37.690018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:37.690429 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:37.690031 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:37.690429 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:37.690108 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:37.690429 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:37.690151 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:38.987716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.986406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f8rtw" event={"ID":"5dbfad1a-734c-497e-bd8b-fa4326c5d24a","Type":"ContainerStarted","Data":"72b0af291f2126586825584946f6c0de27150202a91b5303bdf85357026990f5"} Sep 10 18:31:38.989355 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.989329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" event={"ID":"38adc0fb-1a54-4838-b8fd-65a2444021e6","Type":"ContainerStarted","Data":"1805c00f7603a2db768e1379ff5ebf51031716c919e30b986692c1f7beef0e17"} Sep 10 18:31:38.990711 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.990688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" event={"ID":"49b2af53-962d-4d9d-821f-7cb0a24f0150","Type":"ContainerStarted","Data":"46af3e4236bd3cbff922450e54058a6227a40bac8a6910d85a31ffffb56145c3"} Sep 10 18:31:38.992083 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.992047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxzql" event={"ID":"9c6706f9-b195-4f6d-9a6a-375dd10c75f4","Type":"ContainerStarted","Data":"7d6f89a5f398a2fe82fe62c2c7ca3e3c8f81c4e30b27a45bf48c57ed4e379ea2"} Sep 10 18:31:38.994714 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.994696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:31:38.995022 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995005 2579 generic.go:356] "Generic (PLEG): container finished" podID="b5384087-b807-40a4-a982-6ca6df7050bd" containerID="20bae91c0b3702f1d58db9316df6a258035028b11f41ed6f558bf612ce684026" exitCode=1 Sep 10 18:31:38.995096 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"6d424118b130261fa36d8451eb15c69de50aa14758cb766decab843f46791887"} Sep 10 18:31:38.995141 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"b049a65f5c0aeb0b8629b5618edad19ebcafbfe9c0f5ff76b14874503758ad78"} Sep 10 18:31:38.995180 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"5267f6bfee4aaad2838ed386df3a33c1a6b056b99da1ad340a251b4419ff1843"} Sep 10 18:31:38.995213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"b56a2047a89a16cad54295e4e1c184739920ddb55a57de48581cba966a5653c5"} Sep 10 18:31:38.995251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerDied","Data":"20bae91c0b3702f1d58db9316df6a258035028b11f41ed6f558bf612ce684026"} Sep 10 18:31:38.995293 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.995269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"6b43363a65d25e80c5a9f736aafab215e09633c9b4fea5d8e08ddae4ac76caca"} Sep 10 18:31:38.996366 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.996348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" event={"ID":"6f9cfc38a9d54d6881403da441b0a834","Type":"ContainerStarted","Data":"2b1fabb0442724188d41bbebf2a29265aa770c26f2bff372823e747cbe97b188"} Sep 10 18:31:38.997609 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.997588 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9cl5z" event={"ID":"5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a","Type":"ContainerStarted","Data":"252fce087ebc0cc75b7f19babb1d56da68748f060ab4c307c66b242d7ab6dab8"} Sep 10 18:31:38.998923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:38.998895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9d7bm" event={"ID":"b396a88f-79df-4aa7-a136-19146def7c13","Type":"ContainerStarted","Data":"bb719a60401982c8b2d779f66a6455f0a0cc722215e8e82f333f8c8694883af6"} Sep 10 18:31:39.000279 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.000258 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="a2c87dfeab0cbf5a67419854322421ffacf41d4aeb2cbe08a2b46e18401af871" exitCode=0 Sep 10 18:31:39.000369 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.000338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"a2c87dfeab0cbf5a67419854322421ffacf41d4aeb2cbe08a2b46e18401af871"} Sep 10 18:31:39.002073 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.002036 2579 generic.go:356] "Generic (PLEG): container finished" podID="1dff361b9784023f163739c4d30ad35d" containerID="6ccabf1c0dbe63017fa073c8a08ebcbce771929513ea9ee27485c52f57d7d130" exitCode=0 Sep 10 18:31:39.002171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.002085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"1dff361b9784023f163739c4d30ad35d","Type":"ContainerDied","Data":"6ccabf1c0dbe63017fa073c8a08ebcbce771929513ea9ee27485c52f57d7d130"} Sep 10 18:31:39.025353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.025310 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f8rtw" podStartSLOduration=2.166509164 podStartE2EDuration="22.02529462s" totalImagesPullingTime="19.858785456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.002050271 +0000 UTC m=+22.835365846" watchObservedRunningTime="2026-09-10 18:31:39.02529462 +0000 UTC m=+22.858610248" Sep 10 18:31:39.043592 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.043549 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4c4ft" podStartSLOduration=2.095342788 podStartE2EDuration="22.043535184s" totalImagesPullingTime="19.948192396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.04322268 +0000 UTC m=+22.876538256" watchObservedRunningTime="2026-09-10 18:31:39.043535184 +0000 UTC m=+22.876850786" Sep 10 18:31:39.059977 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.059917 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9cl5z" podStartSLOduration=1.602829343 podStartE2EDuration="22.059894612s" totalImagesPullingTime="20.457065269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.059423726 +0000 UTC m=+22.892739300" watchObservedRunningTime="2026-09-10 18:31:39.059894612 +0000 UTC m=+22.893210187" Sep 10 18:31:39.089307 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.089257 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" podStartSLOduration=21.089239404 podStartE2EDuration="21.089239404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.074042998 +0000 UTC m=+22.907358573" watchObservedRunningTime="2026-09-10 18:31:39.089239404 +0000 UTC m=+22.922554969" Sep 10 18:31:39.089743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.089720 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxzql" podStartSLOduration=2.125616572 podStartE2EDuration="22.089711184s" totalImagesPullingTime="19.964094612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.089135494 +0000 UTC m=+22.922451068" watchObservedRunningTime="2026-09-10 18:31:39.089711184 +0000 UTC m=+22.923026758" Sep 10 18:31:39.103026 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.102982 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9d7bm" podStartSLOduration=2.200923351 podStartE2EDuration="22.102963048s" totalImagesPullingTime="19.902039697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:39.102842756 +0000 UTC m=+22.936158331" watchObservedRunningTime="2026-09-10 18:31:39.102963048 +0000 UTC m=+22.936278623" Sep 10 18:31:39.690482 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.690410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:39.690482 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.690431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:39.690482 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:39.690441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:39.690663 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:39.690508 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:39.690663 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:39.690573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:39.690663 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:39.690638 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:40.006336 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.006310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"1dff361b9784023f163739c4d30ad35d","Type":"ContainerStarted","Data":"f2827379576b1d061a5e1609fbdcaf7d09c6ec2aca96449a010b65c9a4848ac3"} Sep 10 18:31:40.009327 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.008982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" event={"ID":"38adc0fb-1a54-4838-b8fd-65a2444021e6","Type":"ContainerStarted","Data":"af2beeb0c33d1fe8d27a701d14fa44ca156265d52b9ef48cd8253798dbdf0f18"} Sep 10 18:31:40.011657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.011632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xlvff" event={"ID":"ea401532-b33e-41c2-af7d-0561b3fa8c9b","Type":"ContainerStarted","Data":"bfb31e18fa5f0e39522590c21a205d85b4674ed029938bb02022532f2fd5736c"} Sep 10 18:31:40.011865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.011845 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 18:31:40.035616 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.035569 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" podStartSLOduration=22.035551329 podStartE2EDuration="22.035551329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:40.035387676 +0000 UTC m=+23.868703250" watchObservedRunningTime="2026-09-10 18:31:40.035551329 +0000 UTC m=+23.868866904" Sep 10 18:31:40.657201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.657085 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T18:31:40.011859634Z","UUID":"f3a7f59a-9983-4ea4-8594-ed2c8ba617c1","Handler":null,"Name":"","Endpoint":""} Sep 10 18:31:40.658701 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.658679 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 18:31:40.658833 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:40.658713 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 18:31:41.690821 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:41.690583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:41.691252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:41.690616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:41.691252 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:41.690864 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:41.691252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:41.690621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:41.691252 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:41.690935 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:41.691252 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:41.690992 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:42.019144 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.018723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" event={"ID":"38adc0fb-1a54-4838-b8fd-65a2444021e6","Type":"ContainerStarted","Data":"2aefd8d19a7b952520c84cae78e7117221017f21d08c69461b5f170e8118aa97"} Sep 10 18:31:42.022554 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.022532 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:31:42.022942 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.022916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"d6fcd75628cb59bb71b7c4b59b8ddbe4e33c3c477463470b22462aa90a77a7ac"} Sep 10 18:31:42.038385 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.038331 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xlvff" podStartSLOduration=5.203289435 podStartE2EDuration="25.038314366s" totalImagesPullingTime="19.835024931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:40.05998584 +0000 UTC m=+23.893301415" watchObservedRunningTime="2026-09-10 18:31:42.038314366 +0000 UTC m=+25.871629940" Sep 10 18:31:42.038633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.038611 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n89wl" podStartSLOduration=2.71012712 podStartE2EDuration="25.038603236s" totalImagesPullingTime="22.328476116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:42.03814503 +0000 UTC m=+25.871460603" watchObservedRunningTime="2026-09-10 18:31:42.038603236 +0000 UTC m=+25.871918810" Sep 10 18:31:42.164068 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.164023 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:42.191252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.191216 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:42.191478 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.191454 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:42.191865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:42.191848 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxzql" Sep 10 18:31:43.690635 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:43.690595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:43.691102 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:43.690596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:43.691102 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:43.690751 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:43.691102 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:43.690596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:43.691102 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:43.690816 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:43.691102 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:43.690885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:44.031294 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:44.031268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:31:44.031667 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:44.031644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"031cc6305d9f95fac38f9116fd8c337e212c6f2ed5e73e495bc7337124073940"} Sep 10 18:31:44.032148 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:44.032125 2579 scope.go:117] "RemoveContainer" containerID="20bae91c0b3702f1d58db9316df6a258035028b11f41ed6f558bf612ce684026" Sep 10 18:31:45.037420 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.037240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:31:45.037825 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.037804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" event={"ID":"b5384087-b807-40a4-a982-6ca6df7050bd","Type":"ContainerStarted","Data":"40b3555fb81bbc1716570b7ef393ab3998e3e9577ab9057e6a311c9a35a1e8ca"} Sep 10 18:31:45.037921 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.037900 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:45.038144 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.038128 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:45.038231 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.038192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:45.041045 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.041014 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="13bafb743d5e8c71aa41ee0b62a2070058984bc74243b593a37fb91a12683787" exitCode=0 Sep 10 18:31:45.041159 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.041083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"13bafb743d5e8c71aa41ee0b62a2070058984bc74243b593a37fb91a12683787"} Sep 10 18:31:45.055273 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.055247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:45.055398 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.055388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:31:45.067993 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.067951 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" podStartSLOduration=8.037084888 podStartE2EDuration="28.067937554s" totalImagesPullingTime="20.030852666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:45.066084049 +0000 UTC m=+28.899399629" watchObservedRunningTime="2026-09-10 18:31:45.067937554 +0000 UTC m=+28.901253127" Sep 10 18:31:45.690990 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.690956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:45.690990 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.690981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:45.691244 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.690955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:45.691244 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:45.691124 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:45.691244 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:45.691229 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:45.691362 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:45.691338 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:45.871385 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.871354 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22lxr"] Sep 10 18:31:45.874442 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.874415 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh4jl"] Sep 10 18:31:45.874978 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:45.874954 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r29np"] Sep 10 18:31:46.045928 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:46.045892 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="4a56713db838ee9e1acace054ac49b8a6580f22cb5a62cb0606ce5c5e605286e" exitCode=0 Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:46.045956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:46.045988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"4a56713db838ee9e1acace054ac49b8a6580f22cb5a62cb0606ce5c5e605286e"} Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:46.046086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:46.046101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:46.046183 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:46.046251 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:46.046850 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:46.046398 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:47.050936 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:47.050603 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="71e8b0d1ba764429b38888ab9cab0443e2fb9c9d0c61fcd3c8418110a44d5d1a" exitCode=0 Sep 10 18:31:47.050936 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:47.050688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"71e8b0d1ba764429b38888ab9cab0443e2fb9c9d0c61fcd3c8418110a44d5d1a"} Sep 10 18:31:47.690544 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:47.690440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:47.690544 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:47.690530 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:47.690762 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:47.690625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:47.690762 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:47.690646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:47.690762 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:47.690734 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:47.690916 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:47.690810 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:49.447780 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.447736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:49.448280 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.447834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:49.448280 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.447912 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:49.448280 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.447958 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:49.448280 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.447994 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret podName:f99c2cd7-f34d-400b-8e20-0f1cdf38e95c nodeName:}" failed. No retries permitted until 2026-09-10 18:32:21.447972325 +0000 UTC m=+65.281287881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret") pod "global-pull-secret-syncer-22lxr" (UID: "f99c2cd7-f34d-400b-8e20-0f1cdf38e95c") : object "kube-system"/"original-pull-secret" not registered Sep 10 18:31:49.448280 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.448020 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:32:21.448003588 +0000 UTC m=+65.281319147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 18:31:49.548594 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.548555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:49.548760 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.548738 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 18:31:49.548820 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.548767 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 18:31:49.548820 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.548779 2579 projected.go:196] Error preparing data for projected volume kube-api-access-hdgkx for pod openshift-network-diagnostics/network-check-target-r29np: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:49.548916 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.548829 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx podName:d4940d90-0f36-4c8b-ada0-5fae02d1e697 nodeName:}" failed. No retries permitted until 2026-09-10 18:32:21.548816556 +0000 UTC m=+65.382132108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdgkx" (UniqueName: "kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx") pod "network-check-target-r29np" (UID: "d4940d90-0f36-4c8b-ada0-5fae02d1e697") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.690207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.690248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:49.690258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.690335 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.690460 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:49.690532 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:49.690527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:51.690572 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:51.690538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:51.691155 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:51.690538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:51.691155 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:51.690676 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r29np" podUID="d4940d90-0f36-4c8b-ada0-5fae02d1e697" Sep 10 18:31:51.691155 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:51.690538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:51.691155 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:51.690736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22lxr" podUID="f99c2cd7-f34d-400b-8e20-0f1cdf38e95c" Sep 10 18:31:51.691155 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:51.690799 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:31:52.067129 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.067097 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="8539176ddbe108e03579f4a75a8acafd3a9d95d7c83218e1ee89fa32acc2f98c" exitCode=0 Sep 10 18:31:52.067272 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.067145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"8539176ddbe108e03579f4a75a8acafd3a9d95d7c83218e1ee89fa32acc2f98c"} Sep 10 18:31:52.448440 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.448363 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeReady" Sep 10 18:31:52.448579 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.448529 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 18:31:52.499253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.499218 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-72vfr"] Sep 10 18:31:52.507700 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.507671 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5sdjc"] Sep 10 18:31:52.507873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.507802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.511302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.511280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4lj58\"" Sep 10 18:31:52.511580 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.511499 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 18:31:52.511703 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.511679 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 18:31:52.521903 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.521882 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-72vfr"] Sep 10 18:31:52.522018 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.521975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.525044 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.525021 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h28kp\"" Sep 10 18:31:52.525044 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.525038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 18:31:52.525377 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.525351 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 18:31:52.525470 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.525383 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 18:31:52.525932 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.525910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sdjc"] Sep 10 18:31:52.673126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.673126 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p66\" (UniqueName: \"kubernetes.io/projected/dce5b0a7-24c2-434f-bc84-e9c4b3842545-kube-api-access-c5p66\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.673340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b7909b9f-509e-44dd-bee7-26c83608452c-config-volume\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.673340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce5b0a7-24c2-434f-bc84-e9c4b3842545-cert\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.673340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8plh\" (UniqueName: \"kubernetes.io/projected/b7909b9f-509e-44dd-bee7-26c83608452c-kube-api-access-c8plh\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.673340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.673319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7909b9f-509e-44dd-bee7-26c83608452c-tmp-dir\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.774500 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7909b9f-509e-44dd-bee7-26c83608452c-tmp-dir\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.774500 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p66\" (UniqueName: \"kubernetes.io/projected/dce5b0a7-24c2-434f-bc84-e9c4b3842545-kube-api-access-c5p66\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b7909b9f-509e-44dd-bee7-26c83608452c-config-volume\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce5b0a7-24c2-434f-bc84-e9c4b3842545-cert\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8plh\" (UniqueName: \"kubernetes.io/projected/b7909b9f-509e-44dd-bee7-26c83608452c-kube-api-access-c8plh\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:52.774643 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:52.774729 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:53.274705264 +0000 UTC m=+37.108020832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:31:52.774994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.774783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7909b9f-509e-44dd-bee7-26c83608452c-tmp-dir\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.775326 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.775167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b7909b9f-509e-44dd-bee7-26c83608452c-config-volume\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.779334 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.779307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce5b0a7-24c2-434f-bc84-e9c4b3842545-cert\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.785234 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.785204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8plh\" (UniqueName: \"kubernetes.io/projected/b7909b9f-509e-44dd-bee7-26c83608452c-kube-api-access-c8plh\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:52.785368 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.785286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p66\" (UniqueName: \"kubernetes.io/projected/dce5b0a7-24c2-434f-bc84-e9c4b3842545-kube-api-access-c5p66\") pod \"ingress-canary-5sdjc\" (UID: \"dce5b0a7-24c2-434f-bc84-e9c4b3842545\") " pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:52.831393 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:52.831356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sdjc" Sep 10 18:31:53.073138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.072870 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a1744af-af41-4f82-a5d6-210344b45a3b" containerID="c5348b38c03583b44ccf1e54c6f65817ba08da355cfcfb2024cdaf3aea1a8e79" exitCode=0 Sep 10 18:31:53.073138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.072956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerDied","Data":"c5348b38c03583b44ccf1e54c6f65817ba08da355cfcfb2024cdaf3aea1a8e79"} Sep 10 18:31:53.146324 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.146282 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sdjc"] Sep 10 18:31:53.151417 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:31:53.151373 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce5b0a7_24c2_434f_bc84_e9c4b3842545.slice/crio-c946694302eef070a35cf2c0a0cb2c8f9c72aef6bbb30169eef07101844ee4ac WatchSource:0}: Error finding container c946694302eef070a35cf2c0a0cb2c8f9c72aef6bbb30169eef07101844ee4ac: Status 404 returned error can't find the container with id c946694302eef070a35cf2c0a0cb2c8f9c72aef6bbb30169eef07101844ee4ac Sep 10 18:31:53.279513 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.279469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:53.279684 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:53.279623 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:31:53.279727 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:53.279693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:54.279677186 +0000 UTC m=+38.112992738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:31:53.690506 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.690467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:31:53.690506 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.690506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:31:53.690771 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.690467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:31:53.693657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.693628 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 18:31:53.693905 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.693884 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 18:31:53.693996 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.693941 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 18:31:53.693996 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.693945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 18:31:53.694706 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.694679 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxnbp\"" Sep 10 18:31:53.694706 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:53.694699 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thvkz\"" Sep 10 18:31:54.076884 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:54.076795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sdjc" event={"ID":"dce5b0a7-24c2-434f-bc84-e9c4b3842545","Type":"ContainerStarted","Data":"c946694302eef070a35cf2c0a0cb2c8f9c72aef6bbb30169eef07101844ee4ac"} Sep 10 18:31:54.081112 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:54.081081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" event={"ID":"8a1744af-af41-4f82-a5d6-210344b45a3b","Type":"ContainerStarted","Data":"7c966752ee8ef3a359e6ebb6340cd0e60ba516577d12d24d8b1fef286049c0cd"} Sep 10 18:31:54.105573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:54.105513 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jhwrm" podStartSLOduration=6.24374495 podStartE2EDuration="37.105489703s" totalImagesPullingTime="30.861744753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:54.10403621 +0000 UTC m=+37.937351783" watchObservedRunningTime="2026-09-10 18:31:54.105489703 +0000 UTC m=+37.938805268" Sep 10 18:31:54.288138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:54.288107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:54.288314 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:54.288224 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:31:54.288314 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:54.288298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:31:56.288281256 +0000 UTC m=+40.121596811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:31:56.305114 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:56.305039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:31:56.305607 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:56.305203 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:31:56.305607 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:31:56.305272 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:32:00.305254575 +0000 UTC m=+44.138570131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:31:57.090896 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:57.090860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sdjc" event={"ID":"dce5b0a7-24c2-434f-bc84-e9c4b3842545","Type":"ContainerStarted","Data":"a7b8990f2f4e85cf4d37160b3356020ab2afc2c2b75ba945dde568f2468e03e6"} Sep 10 18:31:57.107472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:31:57.107422 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5sdjc" podStartSLOduration=2.154197852 podStartE2EDuration="5.107403895s" totalImagesPullingTime="2.953206043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:31:57.105933577 +0000 UTC m=+40.939249150" watchObservedRunningTime="2026-09-10 18:31:57.107403895 +0000 UTC m=+40.940719481" Sep 10 18:32:00.328781 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:00.328737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:32:00.329206 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:00.328855 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:32:00.329206 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:00.328908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:32:08.328894787 +0000 UTC m=+52.162210340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:32:08.388256 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:08.388215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:32:08.388747 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:08.388337 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:32:08.388747 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:08.388389 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:32:24.38837357 +0000 UTC m=+68.221689123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:32:17.061938 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:17.061910 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hhz7s" Sep 10 18:32:21.478882 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.478846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:32:21.479355 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.478906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:32:21.482028 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.482001 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 18:32:21.482147 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.482014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 18:32:21.489828 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:21.489805 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 18:32:21.489950 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:21.489888 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:33:25.489864055 +0000 UTC m=+129.323179607 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : secret "metrics-daemon-secret" not found Sep 10 18:32:21.492615 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.492596 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f99c2cd7-f34d-400b-8e20-0f1cdf38e95c-original-pull-secret\") pod \"global-pull-secret-syncer-22lxr\" (UID: \"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c\") " pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:32:21.579259 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.579218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:32:21.582525 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.582501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 18:32:21.592527 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.592499 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 18:32:21.602287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.602258 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgkx\" (UniqueName: \"kubernetes.io/projected/d4940d90-0f36-4c8b-ada0-5fae02d1e697-kube-api-access-hdgkx\") pod \"network-check-target-r29np\" (UID: \"d4940d90-0f36-4c8b-ada0-5fae02d1e697\") " pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:32:21.609697 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.609676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxnbp\"" Sep 10 18:32:21.610687 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.610669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22lxr" Sep 10 18:32:21.617895 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.617875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:32:21.918801 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.918769 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22lxr"] Sep 10 18:32:21.921645 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:32:21.921616 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99c2cd7_f34d_400b_8e20_0f1cdf38e95c.slice/crio-b2567fa3b29b0c942f97a74c88da50ef4c92a3e5ef88ac1a42b7c8d7f23a0c61 WatchSource:0}: Error finding container b2567fa3b29b0c942f97a74c88da50ef4c92a3e5ef88ac1a42b7c8d7f23a0c61: Status 404 returned error can't find the container with id b2567fa3b29b0c942f97a74c88da50ef4c92a3e5ef88ac1a42b7c8d7f23a0c61 Sep 10 18:32:21.958259 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:21.958146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r29np"] Sep 10 18:32:21.960961 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:32:21.960932 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4940d90_0f36_4c8b_ada0_5fae02d1e697.slice/crio-6062f8316db73c38a6310a40473772113672aef3fd7338efea641c47f13a12be WatchSource:0}: Error finding container 6062f8316db73c38a6310a40473772113672aef3fd7338efea641c47f13a12be: Status 404 returned error can't find the container with id 6062f8316db73c38a6310a40473772113672aef3fd7338efea641c47f13a12be Sep 10 18:32:22.153162 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:22.153131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r29np" event={"ID":"d4940d90-0f36-4c8b-ada0-5fae02d1e697","Type":"ContainerStarted","Data":"6062f8316db73c38a6310a40473772113672aef3fd7338efea641c47f13a12be"} Sep 10 18:32:22.154314 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:22.154288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22lxr" event={"ID":"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c","Type":"ContainerStarted","Data":"b2567fa3b29b0c942f97a74c88da50ef4c92a3e5ef88ac1a42b7c8d7f23a0c61"} Sep 10 18:32:24.402321 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:24.402287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:32:24.402738 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:24.402438 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:32:24.402738 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:24.402507 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:32:56.402488437 +0000 UTC m=+100.235804003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:32:27.168974 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:27.168940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r29np" event={"ID":"d4940d90-0f36-4c8b-ada0-5fae02d1e697","Type":"ContainerStarted","Data":"ef6b16ee230e3790c315ca0aceb68615da1ae8e04b8758635a243f84a667f6e8"} Sep 10 18:32:27.169430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:27.169070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:32:27.170472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:27.170450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22lxr" event={"ID":"f99c2cd7-f34d-400b-8e20-0f1cdf38e95c","Type":"ContainerStarted","Data":"801c9ea05c93200ccd1b994796a89d5700dc631e96393c8cdaabfc81a9a4223f"} Sep 10 18:32:27.185002 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:27.184961 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r29np" podStartSLOduration=65.838717816 podStartE2EDuration="1m10.184949806s" totalImagesPullingTime="4.34623199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:32:27.183892584 +0000 UTC m=+71.017208158" watchObservedRunningTime="2026-09-10 18:32:27.184949806 +0000 UTC m=+71.018265371" Sep 10 18:32:27.198523 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:27.198486 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22lxr" podStartSLOduration=65.808243625 podStartE2EDuration="1m10.198474978s" totalImagesPullingTime="4.390231353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:32:27.197778302 +0000 UTC m=+71.031093875" watchObservedRunningTime="2026-09-10 18:32:27.198474978 +0000 UTC m=+71.031790552" Sep 10 18:32:52.947356 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.947229 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6"] Sep 10 18:32:52.951430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.951410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:52.954162 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.954135 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 18:32:52.955512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.955484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dhd8x\"" Sep 10 18:32:52.955512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.955493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 18:32:52.955748 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.955616 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 18:32:52.955845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.955825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 18:32:52.959850 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.959827 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6"] Sep 10 18:32:52.996703 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.996664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56aa2f15-a670-4504-be37-2963640b6778-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:52.996888 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:52.996727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdfdq\" (UniqueName: \"kubernetes.io/projected/56aa2f15-a670-4504-be37-2963640b6778-kube-api-access-bdfdq\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.097803 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.097749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56aa2f15-a670-4504-be37-2963640b6778-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.097994 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.097913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdfdq\" (UniqueName: \"kubernetes.io/projected/56aa2f15-a670-4504-be37-2963640b6778-kube-api-access-bdfdq\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.100270 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.100249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56aa2f15-a670-4504-be37-2963640b6778-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.106194 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.106164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdfdq\" (UniqueName: \"kubernetes.io/projected/56aa2f15-a670-4504-be37-2963640b6778-kube-api-access-bdfdq\") pod \"managed-serviceaccount-addon-agent-64c47d9d44-pldh6\" (UID: \"56aa2f15-a670-4504-be37-2963640b6778\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.269902 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.269807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" Sep 10 18:32:53.534156 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:53.534082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6"] Sep 10 18:32:53.537586 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:32:53.537553 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56aa2f15_a670_4504_be37_2963640b6778.slice/crio-287ff006c51e88d4d0e57ea5ca50ae511674bfc292c53641400dabbc6627b04c WatchSource:0}: Error finding container 287ff006c51e88d4d0e57ea5ca50ae511674bfc292c53641400dabbc6627b04c: Status 404 returned error can't find the container with id 287ff006c51e88d4d0e57ea5ca50ae511674bfc292c53641400dabbc6627b04c Sep 10 18:32:54.242540 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:54.242492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" event={"ID":"56aa2f15-a670-4504-be37-2963640b6778","Type":"ContainerStarted","Data":"287ff006c51e88d4d0e57ea5ca50ae511674bfc292c53641400dabbc6627b04c"} Sep 10 18:32:56.421763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:56.421726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:32:56.422274 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:56.421915 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:32:56.422274 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:32:56.422004 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:34:00.421982045 +0000 UTC m=+164.255297600 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:32:57.252608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:57.252571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" event={"ID":"56aa2f15-a670-4504-be37-2963640b6778","Type":"ContainerStarted","Data":"b390dcf81aabfdb5d4773874cb512390e467187492b14f41c1f30b95cbb79dd6"} Sep 10 18:32:57.267094 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:57.267026 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" podStartSLOduration=2.021521971 podStartE2EDuration="5.267010439s" totalImagesPullingTime="3.245488468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:32:57.266591267 +0000 UTC m=+101.099906842" watchObservedRunningTime="2026-09-10 18:32:57.267010439 +0000 UTC m=+101.100325991" Sep 10 18:32:58.175637 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:32:58.175602 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r29np" Sep 10 18:33:25.517499 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:33:25.517459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:33:25.517966 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:33:25.517570 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 18:33:25.517966 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:33:25.517623 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:27.517608327 +0000 UTC m=+251.350923879 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : secret "metrics-daemon-secret" not found Sep 10 18:33:55.517457 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:33:55.517396 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-72vfr" podUID="b7909b9f-509e-44dd-bee7-26c83608452c" Sep 10 18:33:56.399848 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:33:56.399819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-72vfr" Sep 10 18:33:56.700746 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:33:56.700658 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:34:00.462520 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:00.462481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:34:00.462962 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:34:00.462640 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 18:34:00.462962 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:34:00.462711 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls podName:b7909b9f-509e-44dd-bee7-26c83608452c nodeName:}" failed. No retries permitted until 2026-09-10 18:36:02.462692539 +0000 UTC m=+286.296008097 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls") pod "dns-default-72vfr" (UID: "b7909b9f-509e-44dd-bee7-26c83608452c") : secret "dns-default-metrics-tls" not found Sep 10 18:34:10.690964 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:10.690864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:34:57.547513 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:57.547478 2579 generic.go:356] "Generic (PLEG): container finished" podID="56aa2f15-a670-4504-be37-2963640b6778" containerID="b390dcf81aabfdb5d4773874cb512390e467187492b14f41c1f30b95cbb79dd6" exitCode=255 Sep 10 18:34:57.547902 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:57.547525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" event={"ID":"56aa2f15-a670-4504-be37-2963640b6778","Type":"ContainerDied","Data":"b390dcf81aabfdb5d4773874cb512390e467187492b14f41c1f30b95cbb79dd6"} Sep 10 18:34:57.553256 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:57.553235 2579 scope.go:117] "RemoveContainer" containerID="b390dcf81aabfdb5d4773874cb512390e467187492b14f41c1f30b95cbb79dd6" Sep 10 18:34:58.557159 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:34:58.557119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c47d9d44-pldh6" event={"ID":"56aa2f15-a670-4504-be37-2963640b6778","Type":"ContainerStarted","Data":"f2149df3b55e7983675b3436984ee645b6be949fd544b785e2b4456401c9c08c"} Sep 10 18:35:08.438046 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.438006 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn"] Sep 10 18:35:08.440779 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.440755 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f55f66b6d-slj2l"] Sep 10 18:35:08.440944 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.440924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.443531 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.443463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.443801 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.443768 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 18:35:08.445635 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.445582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 18:35:08.445741 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.445637 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 18:35:08.445810 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.445763 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdthc\"" Sep 10 18:35:08.445899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.445838 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 18:35:08.446966 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.446941 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cdl24\"" Sep 10 18:35:08.447135 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447071 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 18:35:08.447135 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447079 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 18:35:08.447267 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447172 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 18:35:08.447267 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447211 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 18:35:08.447445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447420 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 18:35:08.447559 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.447493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 18:35:08.452380 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.452357 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn"] Sep 10 18:35:08.466920 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.466893 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55f66b6d-slj2l"] Sep 10 18:35:08.508010 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.507985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bbk\" (UniqueName: \"kubernetes.io/projected/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-kube-api-access-m9bbk\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.508119 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.508119 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-stats-auth\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.508119 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.508221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-default-certificate\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.508221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-kube-api-access-fmsnr\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.508221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.508221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.508210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.537640 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.537616 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x"] Sep 10 18:35:08.540431 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.540414 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-k5xkt"] Sep 10 18:35:08.540538 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.540523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.542989 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.542971 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-875d9847d-jsthf"] Sep 10 18:35:08.543101 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.543088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.543710 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.543688 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 18:35:08.543793 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.543723 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 18:35:08.543845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.543816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-znn89\"" Sep 10 18:35:08.543890 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.543816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 18:35:08.545790 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.545768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.546264 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.546236 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 18:35:08.546363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.546236 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 18:35:08.546363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.546291 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 18:35:08.546363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.546296 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 18:35:08.546532 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.546375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7jjsz\"" Sep 10 18:35:08.549848 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.549827 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 18:35:08.549935 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.549872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 18:35:08.549975 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.549929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgqmb\"" Sep 10 18:35:08.549975 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.549875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 18:35:08.560815 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.560792 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x"] Sep 10 18:35:08.561913 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.561892 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 18:35:08.562346 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.562314 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-k5xkt"] Sep 10 18:35:08.563380 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.563361 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-875d9847d-jsthf"] Sep 10 18:35:08.563591 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.563572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 18:35:08.608632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.608632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bbk\" (UniqueName: \"kubernetes.io/projected/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-kube-api-access-m9bbk\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.608775 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vtg\" (UniqueName: \"kubernetes.io/projected/2a22b7a8-59d7-4760-a946-46cfb89023fe-kube-api-access-b2vtg\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.608775 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.608775 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.608881 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.608793 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:08.608881 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.608842 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:09.108828376 +0000 UTC m=+232.942143933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:08.608881 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-default-certificate\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.608983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a22b7a8-59d7-4760-a946-46cfb89023fe-serving-cert\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.608983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-kube-api-access-fmsnr\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.608983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-tmp\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.608983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpz56\" (UniqueName: \"kubernetes.io/projected/e4bf8ea9-cd63-417e-b2be-a925498a359a-kube-api-access-hpz56\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-stats-auth\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.609078 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609123 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.609124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:09.109112361 +0000 UTC m=+232.942427917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-snapshots\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjbx\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609376 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.609646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.609646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.609646 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.609548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.609790 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.609673 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:09.10965459 +0000 UTC m=+232.942970161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:08.610085 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.610047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.611277 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.611261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-stats-auth\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.611326 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.611293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-default-certificate\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.618563 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.618539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsnr\" (UniqueName: \"kubernetes.io/projected/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-kube-api-access-fmsnr\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:08.618709 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.618693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bbk\" (UniqueName: \"kubernetes.io/projected/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-kube-api-access-m9bbk\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:08.710702 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.710702 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vtg\" (UniqueName: \"kubernetes.io/projected/2a22b7a8-59d7-4760-a946-46cfb89023fe-kube-api-access-b2vtg\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.710845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.710845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a22b7a8-59d7-4760-a946-46cfb89023fe-serving-cert\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.710845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-tmp\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.711006 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpz56\" (UniqueName: \"kubernetes.io/projected/e4bf8ea9-cd63-417e-b2be-a925498a359a-kube-api-access-hpz56\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.711006 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711006 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-snapshots\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.711006 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.711006 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.710983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711289 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjbx\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711289 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.711125 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 18:35:08.711289 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.711180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls podName:e4bf8ea9-cd63-417e-b2be-a925498a359a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:09.211164897 +0000 UTC m=+233.044480450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-q6d4x" (UID: "e4bf8ea9-cd63-417e-b2be-a925498a359a") : secret "samples-operator-tls" not found Sep 10 18:35:08.711445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.711445 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.711693 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-tmp\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.711693 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.711518 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:08.711693 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.711532 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:08.711693 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:08.711572 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:09.211557244 +0000 UTC m=+233.044872813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:08.711951 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.711951 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.711909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.712129 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.712104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.712241 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.712218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.712342 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.712322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a22b7a8-59d7-4760-a946-46cfb89023fe-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.712442 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.712419 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a22b7a8-59d7-4760-a946-46cfb89023fe-snapshots\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.713128 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.713108 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a22b7a8-59d7-4760-a946-46cfb89023fe-serving-cert\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.713446 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.713430 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.713709 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.713688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.719537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.719516 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vtg\" (UniqueName: \"kubernetes.io/projected/2a22b7a8-59d7-4760-a946-46cfb89023fe-kube-api-access-b2vtg\") pod \"insights-operator-76bcd6ccf5-k5xkt\" (UID: \"2a22b7a8-59d7-4760-a946-46cfb89023fe\") " pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:08.719642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.719573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.720076 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.720045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjbx\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:08.720246 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.720229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpz56\" (UniqueName: \"kubernetes.io/projected/e4bf8ea9-cd63-417e-b2be-a925498a359a-kube-api-access-hpz56\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:08.859670 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:08.859638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" Sep 10 18:35:09.114835 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.114810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:09.114967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.114872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:09.114967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.114917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:09.114967 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.114954 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:09.115080 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.115010 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:09.115080 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.115023 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:10.115006818 +0000 UTC m=+233.948322370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:09.115080 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.115037 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:10.115031195 +0000 UTC m=+233.948346747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:09.115080 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.115069 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:10.115041542 +0000 UTC m=+233.948357094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:09.127687 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.127670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-k5xkt"] Sep 10 18:35:09.129886 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:09.129864 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a22b7a8_59d7_4760_a946_46cfb89023fe.slice/crio-89bb6572ebbd0fa779fb2c7a3e4df1f6b675318b8245d3fdf167be09ffee042f WatchSource:0}: Error finding container 89bb6572ebbd0fa779fb2c7a3e4df1f6b675318b8245d3fdf167be09ffee042f: Status 404 returned error can't find the container with id 89bb6572ebbd0fa779fb2c7a3e4df1f6b675318b8245d3fdf167be09ffee042f Sep 10 18:35:09.215773 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.215748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:09.215857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.215779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:09.215896 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.215865 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:09.215896 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.215869 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 18:35:09.215967 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.215913 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls podName:e4bf8ea9-cd63-417e-b2be-a925498a359a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:10.215900964 +0000 UTC m=+234.049216515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-q6d4x" (UID: "e4bf8ea9-cd63-417e-b2be-a925498a359a") : secret "samples-operator-tls" not found Sep 10 18:35:09.215967 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.215874 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:09.215967 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:09.215945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:10.215937501 +0000 UTC m=+234.049253052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:09.594334 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:09.594306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" event={"ID":"2a22b7a8-59d7-4760-a946-46cfb89023fe","Type":"ContainerStarted","Data":"89bb6572ebbd0fa779fb2c7a3e4df1f6b675318b8245d3fdf167be09ffee042f"} Sep 10 18:35:10.122049 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:10.122019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:10.122223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:10.122084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:10.122223 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:10.122157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:10.122223 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.122191 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:12.12217121 +0000 UTC m=+235.955486782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:10.122383 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.122243 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:10.122383 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.122248 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:10.122383 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.122292 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:12.122277761 +0000 UTC m=+235.955593316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:10.122383 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.122323 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:12.122305341 +0000 UTC m=+235.955620896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:10.222695 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:10.222669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:10.222837 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:10.222705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:10.222960 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.222834 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 18:35:10.222960 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.222864 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:10.222960 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.222880 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:10.222960 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.222902 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls podName:e4bf8ea9-cd63-417e-b2be-a925498a359a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:12.222883969 +0000 UTC m=+236.056199539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-q6d4x" (UID: "e4bf8ea9-cd63-417e-b2be-a925498a359a") : secret "samples-operator-tls" not found Sep 10 18:35:10.222960 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:10.222923 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:12.22290941 +0000 UTC m=+236.056224978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:11.601521 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:11.601441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" event={"ID":"2a22b7a8-59d7-4760-a946-46cfb89023fe","Type":"ContainerStarted","Data":"0a1e0d0863e59c1ce35b9ae195547540107019f076e4dfbe773ac10cbfa56446"} Sep 10 18:35:11.617022 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:11.616978 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" podStartSLOduration=1.414572536 podStartE2EDuration="3.616962229s" totalImagesPullingTime="2.202389693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:11.616699728 +0000 UTC m=+235.450015304" watchObservedRunningTime="2026-09-10 18:35:11.616962229 +0000 UTC m=+235.450277802" Sep 10 18:35:12.139239 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.139214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:12.139375 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.139268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:12.139375 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.139348 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.139335932 +0000 UTC m=+239.972651505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:12.139375 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.139348 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:12.139483 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.139368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:12.139483 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.139380 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.139371442 +0000 UTC m=+239.972687014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:12.139483 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.139427 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:12.139483 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.139462 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.139451052 +0000 UTC m=+239.972766605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:12.240643 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.240619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:12.240752 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.240737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:12.240798 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.240763 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:12.240798 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.240777 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:12.240863 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.240821 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 18:35:12.240863 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.240826 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.240812109 +0000 UTC m=+240.074127666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:12.240863 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.240858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls podName:e4bf8ea9-cd63-417e-b2be-a925498a359a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.240847207 +0000 UTC m=+240.074162777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-q6d4x" (UID: "e4bf8ea9-cd63-417e-b2be-a925498a359a") : secret "samples-operator-tls" not found Sep 10 18:35:12.763999 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.763970 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rcbhs"] Sep 10 18:35:12.767159 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.767142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.769718 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.769691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 18:35:12.770080 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.770043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 18:35:12.770553 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.770529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n67nc\"" Sep 10 18:35:12.777593 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.777569 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcbhs"] Sep 10 18:35:12.845164 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.845138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6j4\" (UniqueName: \"kubernetes.io/projected/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-api-access-6x6j4\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.845265 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.845182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62847e4-e3ac-44fb-90d0-5998c25cbe02-data-volume\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.845265 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.845205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.845265 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.845255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.845368 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.845304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a62847e4-e3ac-44fb-90d0-5998c25cbe02-crio-socket\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.945805 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.945784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a62847e4-e3ac-44fb-90d0-5998c25cbe02-crio-socket\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.945886 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.945862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6j4\" (UniqueName: \"kubernetes.io/projected/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-api-access-6x6j4\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.945928 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.945891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62847e4-e3ac-44fb-90d0-5998c25cbe02-data-volume\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.945928 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.945899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a62847e4-e3ac-44fb-90d0-5998c25cbe02-crio-socket\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.945928 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.945911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.946014 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.945986 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:12.946073 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.946040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.946127 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.946111 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 18:35:12.946162 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.946118 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:13.446097083 +0000 UTC m=+237.279412639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:12.946203 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:12.946184 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:13.44616747 +0000 UTC m=+237.279483031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : configmap "kube-rbac-proxy" not found Sep 10 18:35:12.946239 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.946216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a62847e4-e3ac-44fb-90d0-5998c25cbe02-data-volume\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:12.956019 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:12.955998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6j4\" (UniqueName: \"kubernetes.io/projected/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-api-access-6x6j4\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:13.449388 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:13.449350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:13.449388 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:13.449402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:13.449573 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:13.449474 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 18:35:13.449573 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:13.449498 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:13.449573 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:13.449541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:14.449523765 +0000 UTC m=+238.282839317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : configmap "kube-rbac-proxy" not found Sep 10 18:35:13.449573 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:13.449565 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:14.44955121 +0000 UTC m=+238.282866762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:14.457396 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:14.457350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:14.457396 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:14.457405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:14.457924 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:14.457528 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:14.457924 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:14.457555 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 18:35:14.457924 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:14.457620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.457596244 +0000 UTC m=+240.290911797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:14.457924 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:14.457643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:16.457631828 +0000 UTC m=+240.290947380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : configmap "kube-rbac-proxy" not found Sep 10 18:35:14.683714 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:14.683689 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9d7bm_b396a88f-79df-4aa7-a136-19146def7c13/dns-node-resolver/0.log" Sep 10 18:35:15.683716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:15.683679 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f8rtw_5dbfad1a-734c-497e-bd8b-fa4326c5d24a/node-ca/0.log" Sep 10 18:35:16.169414 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.169378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:16.169602 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.169454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:16.169602 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.169502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:16.169602 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.169551 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:16.169602 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.169573 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:16.169754 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.169616 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:24.169597727 +0000 UTC m=+248.002913289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:16.169754 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.169632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:24.169624669 +0000 UTC m=+248.002940220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:16.169754 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.169643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:24.169637879 +0000 UTC m=+248.002953431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:16.270560 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.270527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:16.270560 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.270565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:16.270749 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.270669 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 18:35:16.270749 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.270721 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls podName:e4bf8ea9-cd63-417e-b2be-a925498a359a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:24.270707168 +0000 UTC m=+248.104022720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-q6d4x" (UID: "e4bf8ea9-cd63-417e-b2be-a925498a359a") : secret "samples-operator-tls" not found Sep 10 18:35:16.270839 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.270788 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:16.270839 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.270801 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:16.270901 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.270845 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:24.270832806 +0000 UTC m=+248.104148358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:16.283298 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.283270 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sdjc_dce5b0a7-24c2-434f-bc84-e9c4b3842545/serve-healthcheck-canary/0.log" Sep 10 18:35:16.472551 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.472492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:16.472551 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.472532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:16.472713 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.472600 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 18:35:16.472713 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.472638 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:20.47262729 +0000 UTC m=+244.305942842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : configmap "kube-rbac-proxy" not found Sep 10 18:35:16.472891 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.472726 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:16.472891 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:16.472786 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:20.47277041 +0000 UTC m=+244.306085987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:16.696406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.696384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-vjxb9"] Sep 10 18:35:16.700106 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.700092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.702660 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.702631 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 18:35:16.702755 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.702677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 18:35:16.702755 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.702681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 18:35:16.703975 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.703959 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mmfn8\"" Sep 10 18:35:16.704046 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.703984 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 18:35:16.707198 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.707176 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-vjxb9"] Sep 10 18:35:16.774875 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.774825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-key\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.774967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.774883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-cabundle\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.774967 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.774900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrq9\" (UniqueName: \"kubernetes.io/projected/0fde9699-9090-47a3-b2a2-e7215e483e2a-kube-api-access-wxrq9\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.875625 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.875603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-key\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.875696 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.875661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-cabundle\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.875798 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.875775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrq9\" (UniqueName: \"kubernetes.io/projected/0fde9699-9090-47a3-b2a2-e7215e483e2a-kube-api-access-wxrq9\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.876228 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.876210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-cabundle\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.877974 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.877949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0fde9699-9090-47a3-b2a2-e7215e483e2a-signing-key\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:16.883658 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:16.883637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrq9\" (UniqueName: \"kubernetes.io/projected/0fde9699-9090-47a3-b2a2-e7215e483e2a-kube-api-access-wxrq9\") pod \"service-ca-75d99c484-vjxb9\" (UID: \"0fde9699-9090-47a3-b2a2-e7215e483e2a\") " pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:17.008211 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:17.008176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-vjxb9" Sep 10 18:35:17.279583 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:17.279560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-vjxb9"] Sep 10 18:35:17.281843 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:17.281807 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fde9699_9090_47a3_b2a2_e7215e483e2a.slice/crio-a5a7db7c47fbf1c6a3b9464dcffc4271d3831c9c18dfdde2f0d4998879f312fe WatchSource:0}: Error finding container a5a7db7c47fbf1c6a3b9464dcffc4271d3831c9c18dfdde2f0d4998879f312fe: Status 404 returned error can't find the container with id a5a7db7c47fbf1c6a3b9464dcffc4271d3831c9c18dfdde2f0d4998879f312fe Sep 10 18:35:17.619684 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:17.619657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-vjxb9" event={"ID":"0fde9699-9090-47a3-b2a2-e7215e483e2a","Type":"ContainerStarted","Data":"a5a7db7c47fbf1c6a3b9464dcffc4271d3831c9c18dfdde2f0d4998879f312fe"} Sep 10 18:35:19.626880 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:19.626849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-vjxb9" event={"ID":"0fde9699-9090-47a3-b2a2-e7215e483e2a","Type":"ContainerStarted","Data":"7f89b9f2dc09baa0c7c923353c41b5c2207bcd2aabb87de77e7553b7c6a767fc"} Sep 10 18:35:19.641177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:19.641135 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-vjxb9" podStartSLOduration=1.480853214 podStartE2EDuration="3.641119715s" totalImagesPullingTime="2.160266501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:19.640713931 +0000 UTC m=+243.474029506" watchObservedRunningTime="2026-09-10 18:35:19.641119715 +0000 UTC m=+243.474435290" Sep 10 18:35:20.504700 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:20.504662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:20.504892 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:20.504720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:20.504892 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:20.504811 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 18:35:20.504892 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:20.504873 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:28.50485535 +0000 UTC m=+252.338170905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : configmap "kube-rbac-proxy" not found Sep 10 18:35:20.505261 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:20.505233 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:20.505410 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:20.505313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:28.505294202 +0000 UTC m=+252.338609767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:24.231766 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.231734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.231776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.231871 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.231920 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:40.231897389 +0000 UTC m=+264.065212956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : configmap references non-existent config key: service-ca.crt Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.231983 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs podName:318e4e83-d575-4bd1-9a2e-76bf5be2b47a nodeName:}" failed. No retries permitted until 2026-09-10 18:35:40.23196116 +0000 UTC m=+264.065276716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs") pod "router-default-6f55f66b6d-slj2l" (UID: "318e4e83-d575-4bd1-9a2e-76bf5be2b47a") : secret "router-metrics-certs-default" not found Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.232040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.232139 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:24.232241 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.232170 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls podName:155cc9f5-5a88-40a8-bbe0-2fa163cc850b nodeName:}" failed. No retries permitted until 2026-09-10 18:35:40.23216043 +0000 UTC m=+264.065475982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xv6jn" (UID: "155cc9f5-5a88-40a8-bbe0-2fa163cc850b") : secret "cluster-monitoring-operator-tls" not found Sep 10 18:35:24.333510 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.333468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:24.333510 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.333514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") pod \"image-registry-875d9847d-jsthf\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:24.333744 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.333627 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 18:35:24.333744 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.333641 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-875d9847d-jsthf: secret "image-registry-tls" not found Sep 10 18:35:24.333744 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:24.333705 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls podName:62a5cedb-9fb1-4ad0-ad86-e2ff189acb13 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:40.333686481 +0000 UTC m=+264.167002034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls") pod "image-registry-875d9847d-jsthf" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13") : secret "image-registry-tls" not found Sep 10 18:35:24.335877 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.335852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4bf8ea9-cd63-417e-b2be-a925498a359a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-q6d4x\" (UID: \"e4bf8ea9-cd63-417e-b2be-a925498a359a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:24.454437 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.454404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-znn89\"" Sep 10 18:35:24.462719 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.462689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" Sep 10 18:35:24.732787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:24.732760 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x"] Sep 10 18:35:25.646103 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:25.646046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" event={"ID":"e4bf8ea9-cd63-417e-b2be-a925498a359a","Type":"ContainerStarted","Data":"c6921dee5546dd324c80c74a7663cd602489e9d9b436788d88e6f41946f7b9e7"} Sep 10 18:35:26.652258 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:26.652224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" event={"ID":"e4bf8ea9-cd63-417e-b2be-a925498a359a","Type":"ContainerStarted","Data":"b34685b1d7873352f7e59bfe608d3115a480219ef433219fc148411d3057e490"} Sep 10 18:35:26.652756 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:26.652306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" event={"ID":"e4bf8ea9-cd63-417e-b2be-a925498a359a","Type":"ContainerStarted","Data":"6da9c6bc6ef41957130f624df667234e0c78ebce241ce0c013e62214205bf74e"} Sep 10 18:35:26.668171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:26.668110 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-q6d4x" podStartSLOduration=16.938338641 podStartE2EDuration="18.668087719s" totalImagesPullingTime="1.729749078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:26.667552401 +0000 UTC m=+250.500867972" watchObservedRunningTime="2026-09-10 18:35:26.668087719 +0000 UTC m=+250.501403289" Sep 10 18:35:27.562540 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:27.562506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:35:27.562757 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:27.562669 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 18:35:27.562757 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:27.562749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs podName:6ec1c3fe-2dd8-48df-b3fe-322ee22f714a nodeName:}" failed. No retries permitted until 2026-09-10 18:37:29.562729534 +0000 UTC m=+373.396045090 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs") pod "network-metrics-daemon-rh4jl" (UID: "6ec1c3fe-2dd8-48df-b3fe-322ee22f714a") : secret "metrics-daemon-secret" not found Sep 10 18:35:28.568671 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:28.568630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:28.569290 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:28.568684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:28.569290 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:28.568787 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 18:35:28.569290 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:28.568866 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls podName:a62847e4-e3ac-44fb-90d0-5998c25cbe02 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:44.568849816 +0000 UTC m=+268.402165368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rcbhs" (UID: "a62847e4-e3ac-44fb-90d0-5998c25cbe02") : secret "insights-runtime-extractor-tls" not found Sep 10 18:35:28.569470 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:28.569373 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a62847e4-e3ac-44fb-90d0-5998c25cbe02-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:35.046949 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.046914 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-875d9847d-jsthf"] Sep 10 18:35:35.047434 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:35.047118 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-875d9847d-jsthf" podUID="62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" Sep 10 18:35:35.678691 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.678660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:35.688316 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.688288 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:35.825120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825069 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825129 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825154 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825176 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtjbx\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825194 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825219 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825389 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token\") pod \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\" (UID: \"62a5cedb-9fb1-4ad0-ad86-e2ff189acb13\") " Sep 10 18:35:35.825537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825434 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:35:35.825537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825443 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:35:35.825685 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825674 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-ca-trust-extracted\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.825742 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825696 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-certificates\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.825860 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.825837 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:35:35.827563 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.827537 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:35:35.827662 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.827555 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:35:35.827791 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.827765 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:35:35.827791 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.827781 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx" (OuterVolumeSpecName: "kube-api-access-qtjbx") pod "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" (UID: "62a5cedb-9fb1-4ad0-ad86-e2ff189acb13"). InnerVolumeSpecName "kube-api-access-qtjbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:35:35.926620 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.926596 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-trusted-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.926620 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.926617 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtjbx\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-kube-api-access-qtjbx\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.926743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.926629 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-installation-pull-secrets\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.926743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.926638 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-image-registry-private-configuration\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:35.926743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:35.926649 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-bound-sa-token\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:36.681884 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:36.681856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-875d9847d-jsthf" Sep 10 18:35:36.710687 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:36.710663 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-875d9847d-jsthf"] Sep 10 18:35:36.713652 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:36.713627 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-875d9847d-jsthf"] Sep 10 18:35:36.834649 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:36.834625 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13-registry-tls\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:35:38.693626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:38.693595 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a5cedb-9fb1-4ad0-ad86-e2ff189acb13" path="/var/lib/kubelet/pods/62a5cedb-9fb1-4ad0-ad86-e2ff189acb13/volumes" Sep 10 18:35:40.258665 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.258616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:40.258665 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.258676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:40.259156 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.258734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:40.259321 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.259294 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-service-ca-bundle\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:40.261122 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.261100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/155cc9f5-5a88-40a8-bbe0-2fa163cc850b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xv6jn\" (UID: \"155cc9f5-5a88-40a8-bbe0-2fa163cc850b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:40.261212 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.261132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318e4e83-d575-4bd1-9a2e-76bf5be2b47a-metrics-certs\") pod \"router-default-6f55f66b6d-slj2l\" (UID: \"318e4e83-d575-4bd1-9a2e-76bf5be2b47a\") " pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:40.555500 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.555426 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdthc\"" Sep 10 18:35:40.560989 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.560972 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cdl24\"" Sep 10 18:35:40.563042 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.563028 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" Sep 10 18:35:40.569217 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.569189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:40.829262 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.829233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn"] Sep 10 18:35:40.831758 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:40.831732 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155cc9f5_5a88_40a8_bbe0_2fa163cc850b.slice/crio-60a51d53907b89c49c7939a42e7edbff1b5ae4b70f9957f0ab475131c41fca59 WatchSource:0}: Error finding container 60a51d53907b89c49c7939a42e7edbff1b5ae4b70f9957f0ab475131c41fca59: Status 404 returned error can't find the container with id 60a51d53907b89c49c7939a42e7edbff1b5ae4b70f9957f0ab475131c41fca59 Sep 10 18:35:40.841311 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:40.841293 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55f66b6d-slj2l"] Sep 10 18:35:40.842820 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:40.842799 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318e4e83_d575_4bd1_9a2e_76bf5be2b47a.slice/crio-0e05bd680126ed66830e9793917198a968b775fdb1df7705c393fb2f73cb9019 WatchSource:0}: Error finding container 0e05bd680126ed66830e9793917198a968b775fdb1df7705c393fb2f73cb9019: Status 404 returned error can't find the container with id 0e05bd680126ed66830e9793917198a968b775fdb1df7705c393fb2f73cb9019 Sep 10 18:35:41.698985 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:41.698947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" event={"ID":"318e4e83-d575-4bd1-9a2e-76bf5be2b47a","Type":"ContainerStarted","Data":"97a6ce46668534a1bf7c8810a4b4f7166220b9dbe7b87287db5ce4d0ba5bc689"} Sep 10 18:35:41.699469 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:41.699014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" event={"ID":"318e4e83-d575-4bd1-9a2e-76bf5be2b47a","Type":"ContainerStarted","Data":"0e05bd680126ed66830e9793917198a968b775fdb1df7705c393fb2f73cb9019"} Sep 10 18:35:41.700181 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:41.700148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" event={"ID":"155cc9f5-5a88-40a8-bbe0-2fa163cc850b","Type":"ContainerStarted","Data":"60a51d53907b89c49c7939a42e7edbff1b5ae4b70f9957f0ab475131c41fca59"} Sep 10 18:35:41.718985 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:41.718944 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" podStartSLOduration=33.718931195 podStartE2EDuration="33.718931195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:41.717410896 +0000 UTC m=+265.550726470" watchObservedRunningTime="2026-09-10 18:35:41.718931195 +0000 UTC m=+265.552246760" Sep 10 18:35:42.570138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:42.570101 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:42.572937 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:42.572915 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:42.702944 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:42.702901 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:42.704343 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:42.704320 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f55f66b6d-slj2l" Sep 10 18:35:43.707873 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:43.707837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" event={"ID":"155cc9f5-5a88-40a8-bbe0-2fa163cc850b","Type":"ContainerStarted","Data":"066d2acabe30175ea582d2aa88cd5baa9b0e267636c86e1041c7a8aca6a61384"} Sep 10 18:35:43.723876 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:43.723824 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xv6jn" podStartSLOduration=33.582700857 podStartE2EDuration="35.723806882s" totalImagesPullingTime="2.141106025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:43.722211305 +0000 UTC m=+267.555526878" watchObservedRunningTime="2026-09-10 18:35:43.723806882 +0000 UTC m=+267.557122458" Sep 10 18:35:44.596435 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:44.596402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:44.598543 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:44.598518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a62847e4-e3ac-44fb-90d0-5998c25cbe02-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rcbhs\" (UID: \"a62847e4-e3ac-44fb-90d0-5998c25cbe02\") " pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:44.879495 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:44.879407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n67nc\"" Sep 10 18:35:44.887751 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:44.887730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rcbhs" Sep 10 18:35:45.153363 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:45.153324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rcbhs"] Sep 10 18:35:45.155623 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:45.155596 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62847e4_e3ac_44fb_90d0_5998c25cbe02.slice/crio-2620feb6e4a774fbfd74e3d61223bdc46b5cb1bac8e2121d9b2658c7e8672a58 WatchSource:0}: Error finding container 2620feb6e4a774fbfd74e3d61223bdc46b5cb1bac8e2121d9b2658c7e8672a58: Status 404 returned error can't find the container with id 2620feb6e4a774fbfd74e3d61223bdc46b5cb1bac8e2121d9b2658c7e8672a58 Sep 10 18:35:45.715117 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:45.715084 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcbhs" event={"ID":"a62847e4-e3ac-44fb-90d0-5998c25cbe02","Type":"ContainerStarted","Data":"3df06798008e7607008553a660c8b3fa688760abd330fbb6de03509b58d35a50"} Sep 10 18:35:45.715261 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:45.715138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcbhs" event={"ID":"a62847e4-e3ac-44fb-90d0-5998c25cbe02","Type":"ContainerStarted","Data":"2620feb6e4a774fbfd74e3d61223bdc46b5cb1bac8e2121d9b2658c7e8672a58"} Sep 10 18:35:46.719698 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:46.719668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcbhs" event={"ID":"a62847e4-e3ac-44fb-90d0-5998c25cbe02","Type":"ContainerStarted","Data":"9e850a72dfc70b30f3353370e79ead63b5825397ba973b6593f3a555e3fc4bcf"} Sep 10 18:35:48.728986 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:48.728958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rcbhs" event={"ID":"a62847e4-e3ac-44fb-90d0-5998c25cbe02","Type":"ContainerStarted","Data":"dd8ee6241c4221ea27bececad946c455ad2e63264b57b3f9265b726b36adc946"} Sep 10 18:35:48.750202 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:48.747333 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rcbhs" podStartSLOduration=34.154929932 podStartE2EDuration="36.747313471s" totalImagesPullingTime="2.592383539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:48.746540773 +0000 UTC m=+272.579856347" watchObservedRunningTime="2026-09-10 18:35:48.747313471 +0000 UTC m=+272.580629045" Sep 10 18:35:52.843577 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.843542 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj"] Sep 10 18:35:52.847153 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.847135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.851447 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.851421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cvttv\"" Sep 10 18:35:52.851572 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.851495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 18:35:52.851630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.851428 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 18:35:52.851680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.851428 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 18:35:52.854543 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.854521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-4lk45"] Sep 10 18:35:52.855917 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.855717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqh8v\" (UniqueName: \"kubernetes.io/projected/09fc6411-60c3-4c13-980e-8da6d08a1901-kube-api-access-nqh8v\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.855917 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.855809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.855917 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.855853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.855917 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.855909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fc6411-60c3-4c13-980e-8da6d08a1901-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.858144 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.858126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.858240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.858200 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj"] Sep 10 18:35:52.860852 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.860832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 18:35:52.860972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.860954 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 18:35:52.861233 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.861213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7d5pr\"" Sep 10 18:35:52.861327 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.861090 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 18:35:52.867912 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.867887 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lxjvp"] Sep 10 18:35:52.871242 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.871225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.872310 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.872290 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-4lk45"] Sep 10 18:35:52.874905 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.874889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 18:35:52.875132 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.875038 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 18:35:52.875229 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.875086 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 18:35:52.876245 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.876223 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rjgtz\"" Sep 10 18:35:52.956306 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.956416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-wtmp\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-textfile\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.956416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-metrics-client-ca\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:52.956504 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-sys\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-root\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:52.956572 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls podName:09fc6411-60c3-4c13-980e-8da6d08a1901 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:53.456553862 +0000 UTC m=+277.289869421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-rn7vj" (UID: "09fc6411-60c3-4c13-980e-8da6d08a1901") : secret "openshift-state-metrics-tls" not found Sep 10 18:35:52.956629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/733cacc3-d3e3-4089-983b-f5e4ac9576a3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d5n7\" (UniqueName: \"kubernetes.io/projected/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-api-access-9d5n7\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fc6411-60c3-4c13-980e-8da6d08a1901-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqh8v\" (UniqueName: \"kubernetes.io/projected/09fc6411-60c3-4c13-980e-8da6d08a1901-kube-api-access-nqh8v\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:52.956972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.956877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d48s\" (UniqueName: \"kubernetes.io/projected/9b7f9cab-cf6c-4702-9004-d90944b842f7-kube-api-access-2d48s\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:52.957480 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.957459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fc6411-60c3-4c13-980e-8da6d08a1901-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.959212 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.959187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:52.965945 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:52.965917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqh8v\" (UniqueName: \"kubernetes.io/projected/09fc6411-60c3-4c13-980e-8da6d08a1901-kube-api-access-nqh8v\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:53.057192 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d48s\" (UniqueName: \"kubernetes.io/projected/9b7f9cab-cf6c-4702-9004-d90944b842f7-kube-api-access-2d48s\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057269 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-wtmp\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057269 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-textfile\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057350 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-metrics-client-ca\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057350 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057492 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057349 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-wtmp\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057492 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057492 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-sys\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-root\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.057633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/733cacc3-d3e3-4089-983b-f5e4ac9576a3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.057633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-textfile\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-sys\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d5n7\" (UniqueName: \"kubernetes.io/projected/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-api-access-9d5n7\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.057829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.058138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.058138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b7f9cab-cf6c-4702-9004-d90944b842f7-metrics-client-ca\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.058138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.057969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b7f9cab-cf6c-4702-9004-d90944b842f7-root\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.058292 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:53.058145 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 18:35:53.058292 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:53.058202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls podName:9b7f9cab-cf6c-4702-9004-d90944b842f7 nodeName:}" failed. No retries permitted until 2026-09-10 18:35:53.558184899 +0000 UTC m=+277.391500456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls") pod "node-exporter-lxjvp" (UID: "9b7f9cab-cf6c-4702-9004-d90944b842f7") : secret "node-exporter-tls" not found Sep 10 18:35:53.058292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.058265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/733cacc3-d3e3-4089-983b-f5e4ac9576a3-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.058651 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.058628 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.058651 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.058640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733cacc3-d3e3-4089-983b-f5e4ac9576a3-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.059840 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.059812 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.060173 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.060155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.060431 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.060410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.065010 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.064989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d48s\" (UniqueName: \"kubernetes.io/projected/9b7f9cab-cf6c-4702-9004-d90944b842f7-kube-api-access-2d48s\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.066397 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.066374 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d5n7\" (UniqueName: \"kubernetes.io/projected/733cacc3-d3e3-4089-983b-f5e4ac9576a3-kube-api-access-9d5n7\") pod \"kube-state-metrics-74cb57df7-4lk45\" (UID: \"733cacc3-d3e3-4089-983b-f5e4ac9576a3\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.168699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.168654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" Sep 10 18:35:53.450165 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.446387 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-4lk45"] Sep 10 18:35:53.462145 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.462121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:53.464552 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.464530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09fc6411-60c3-4c13-980e-8da6d08a1901-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-rn7vj\" (UID: \"09fc6411-60c3-4c13-980e-8da6d08a1901\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:53.562533 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.562506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.564545 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.564522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b7f9cab-cf6c-4702-9004-d90944b842f7-node-exporter-tls\") pod \"node-exporter-lxjvp\" (UID: \"9b7f9cab-cf6c-4702-9004-d90944b842f7\") " pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.745027 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.744973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" event={"ID":"733cacc3-d3e3-4089-983b-f5e4ac9576a3","Type":"ContainerStarted","Data":"9c360ab89aafb86e45e7bbfa40a2b325c42302ee3e2fffef9b3b83f3435c09da"} Sep 10 18:35:53.757212 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.757192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" Sep 10 18:35:53.781347 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:53.781324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lxjvp" Sep 10 18:35:53.793302 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:53.793272 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7f9cab_cf6c_4702_9004_d90944b842f7.slice/crio-7e669df860aded1c0398e13b2e69885a6556b5e064afb7777066ddf34a933bb3 WatchSource:0}: Error finding container 7e669df860aded1c0398e13b2e69885a6556b5e064afb7777066ddf34a933bb3: Status 404 returned error can't find the container with id 7e669df860aded1c0398e13b2e69885a6556b5e064afb7777066ddf34a933bb3 Sep 10 18:35:54.032865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:54.032838 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj"] Sep 10 18:35:54.035161 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:54.035125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fc6411_60c3_4c13_980e_8da6d08a1901.slice/crio-1f329c24e28a7eb59e9a8f801e93999808dadaf131d2b94a0a39c10fbc8de093 WatchSource:0}: Error finding container 1f329c24e28a7eb59e9a8f801e93999808dadaf131d2b94a0a39c10fbc8de093: Status 404 returned error can't find the container with id 1f329c24e28a7eb59e9a8f801e93999808dadaf131d2b94a0a39c10fbc8de093 Sep 10 18:35:54.750737 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:54.750701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" event={"ID":"09fc6411-60c3-4c13-980e-8da6d08a1901","Type":"ContainerStarted","Data":"eb01e655c4825eb4b9944308fe4131232558bf459f2a43e1d7ab9b619fffd8f6"} Sep 10 18:35:54.750909 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:54.750769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" event={"ID":"09fc6411-60c3-4c13-980e-8da6d08a1901","Type":"ContainerStarted","Data":"ccc9f34c3b6df23b734850380101e1bc9929ce474995ba3c90b2aa3496983a47"} Sep 10 18:35:54.750909 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:54.750797 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" event={"ID":"09fc6411-60c3-4c13-980e-8da6d08a1901","Type":"ContainerStarted","Data":"1f329c24e28a7eb59e9a8f801e93999808dadaf131d2b94a0a39c10fbc8de093"} Sep 10 18:35:54.752163 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:54.752134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxjvp" event={"ID":"9b7f9cab-cf6c-4702-9004-d90944b842f7","Type":"ContainerStarted","Data":"7e669df860aded1c0398e13b2e69885a6556b5e064afb7777066ddf34a933bb3"} Sep 10 18:35:55.758493 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.758455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" event={"ID":"09fc6411-60c3-4c13-980e-8da6d08a1901","Type":"ContainerStarted","Data":"d397d3b242f9b26d01b725612c10730d8b0981fc8504d092a705e84408b86eb2"} Sep 10 18:35:55.760906 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.760873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" event={"ID":"733cacc3-d3e3-4089-983b-f5e4ac9576a3","Type":"ContainerStarted","Data":"3c19c46ec7479e1a45b9c4006760539f92214f629ee079535dd58cef9b090b39"} Sep 10 18:35:55.761092 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.760931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" event={"ID":"733cacc3-d3e3-4089-983b-f5e4ac9576a3","Type":"ContainerStarted","Data":"42fe8e69e860d27045c5ae99e26554b7188648a7874c0322d421b7d359caafa5"} Sep 10 18:35:55.761092 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.760961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" event={"ID":"733cacc3-d3e3-4089-983b-f5e4ac9576a3","Type":"ContainerStarted","Data":"2d43fc7cd1c4158a112be3ce1fb621baa1dfc9dbae8554af8d887f68b232c19a"} Sep 10 18:35:55.762899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.762874 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b7f9cab-cf6c-4702-9004-d90944b842f7" containerID="121ad086b6c6154babb63fa191dcbe820837e52c9a1d89c4a6e6b3e39ecf46ab" exitCode=0 Sep 10 18:35:55.763008 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.762937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxjvp" event={"ID":"9b7f9cab-cf6c-4702-9004-d90944b842f7","Type":"ContainerDied","Data":"121ad086b6c6154babb63fa191dcbe820837e52c9a1d89c4a6e6b3e39ecf46ab"} Sep 10 18:35:55.775400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.775354 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-rn7vj" podStartSLOduration=2.427227823 podStartE2EDuration="3.775342719s" totalImagesPullingTime="1.348114896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:55.77464429 +0000 UTC m=+279.607959875" watchObservedRunningTime="2026-09-10 18:35:55.775342719 +0000 UTC m=+279.608658294" Sep 10 18:35:55.809978 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.809934 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-4lk45" podStartSLOduration=2.315110135 podStartE2EDuration="3.809919371s" totalImagesPullingTime="1.494809236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:55.809427206 +0000 UTC m=+279.642742777" watchObservedRunningTime="2026-09-10 18:35:55.809919371 +0000 UTC m=+279.643234947" Sep 10 18:35:55.831166 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.831144 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b99b895f-mvkp5"] Sep 10 18:35:55.835409 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.835389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.838273 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838252 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4jnlhrvcc13o7\"" Sep 10 18:35:55.838400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 18:35:55.838497 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 18:35:55.838738 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 18:35:55.839077 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838882 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 18:35:55.839077 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.838896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jbd56\"" Sep 10 18:35:55.839268 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.839147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 18:35:55.847077 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.847045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b99b895f-mvkp5"] Sep 10 18:35:55.889233 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-grpc-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6hb\" (UniqueName: \"kubernetes.io/projected/523c3e35-bbb7-41e6-a871-73a7e399a739-kube-api-access-wh6hb\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523c3e35-bbb7-41e6-a871-73a7e399a739-metrics-client-ca\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889491 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889491 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889562 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.889562 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.889546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990449 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-grpc-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6hb\" (UniqueName: \"kubernetes.io/projected/523c3e35-bbb7-41e6-a871-73a7e399a739-kube-api-access-wh6hb\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990817 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523c3e35-bbb7-41e6-a871-73a7e399a739-metrics-client-ca\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.990817 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.990598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.991775 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.991754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523c3e35-bbb7-41e6-a871-73a7e399a739-metrics-client-ca\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.993641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.993613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.993740 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.993647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.993740 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.993652 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.993740 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.993708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-grpc-tls\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.993845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.993749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.994211 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.994195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/523c3e35-bbb7-41e6-a871-73a7e399a739-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:55.999632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:55.999604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6hb\" (UniqueName: \"kubernetes.io/projected/523c3e35-bbb7-41e6-a871-73a7e399a739-kube-api-access-wh6hb\") pod \"thanos-querier-86b99b895f-mvkp5\" (UID: \"523c3e35-bbb7-41e6-a871-73a7e399a739\") " pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:56.146188 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.146167 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:35:56.423326 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.423298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b99b895f-mvkp5"] Sep 10 18:35:56.423760 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:56.423738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523c3e35_bbb7_41e6_a871_73a7e399a739.slice/crio-7e86a9f3370424be288efeebd9c5087d0372c527639eefb598f5854224e539cb WatchSource:0}: Error finding container 7e86a9f3370424be288efeebd9c5087d0372c527639eefb598f5854224e539cb: Status 404 returned error can't find the container with id 7e86a9f3370424be288efeebd9c5087d0372c527639eefb598f5854224e539cb Sep 10 18:35:56.770548 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.770481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxjvp" event={"ID":"9b7f9cab-cf6c-4702-9004-d90944b842f7","Type":"ContainerStarted","Data":"b9a0627629671cf13ea7c1fa2483e46d9348fb100f11c67fc9292671d0f52140"} Sep 10 18:35:56.770548 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.770536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxjvp" event={"ID":"9b7f9cab-cf6c-4702-9004-d90944b842f7","Type":"ContainerStarted","Data":"f5f4bef0ac15ecc285bc74b794742eab633907739be427439ac0416636b516e9"} Sep 10 18:35:56.771707 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.771680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"7e86a9f3370424be288efeebd9c5087d0372c527639eefb598f5854224e539cb"} Sep 10 18:35:56.788672 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:56.788626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lxjvp" podStartSLOduration=3.520042108 podStartE2EDuration="4.788612192s" totalImagesPullingTime="1.15447564s" totalInitContainerRuntime="114.094444ms" isStatefulPod=true podCreationTimestamp="2026-09-10 18:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:35:56.787231072 +0000 UTC m=+280.620546648" watchObservedRunningTime="2026-09-10 18:35:56.788612192 +0000 UTC m=+280.621927766" Sep 10 18:35:57.297179 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.297147 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d87dd6979-nnvvv"] Sep 10 18:35:57.300468 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.300446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.303371 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.303351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 18:35:57.304815 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.304792 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f29m2\"" Sep 10 18:35:57.304815 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.304808 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 18:35:57.304992 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.304851 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3tf67abnn8diu\"" Sep 10 18:35:57.304992 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.304866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 18:35:57.304992 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.304802 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 18:35:57.309243 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.309150 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d87dd6979-nnvvv"] Sep 10 18:35:57.400318 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnr65\" (UniqueName: \"kubernetes.io/projected/78d49465-553b-4218-8760-73341c4cbdfd-kube-api-access-tnr65\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400453 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-tls\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400453 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400354 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-metrics-server-audit-profiles\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400453 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-client-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400590 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-client-certs\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400627 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.400627 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.400618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78d49465-553b-4218-8760-73341c4cbdfd-audit-log\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.501858 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.501835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-tls\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.501986 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.501864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-metrics-server-audit-profiles\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.501986 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.501903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-client-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.501986 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.501938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-client-certs\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.502171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.501996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.502171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.502021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78d49465-553b-4218-8760-73341c4cbdfd-audit-log\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.502171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.502086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnr65\" (UniqueName: \"kubernetes.io/projected/78d49465-553b-4218-8760-73341c4cbdfd-kube-api-access-tnr65\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.502782 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.502756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.502894 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.502760 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/78d49465-553b-4218-8760-73341c4cbdfd-audit-log\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.503299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.503273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/78d49465-553b-4218-8760-73341c4cbdfd-metrics-server-audit-profiles\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.504931 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.504884 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-tls\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.504931 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.504888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-client-ca-bundle\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.505217 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.505197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/78d49465-553b-4218-8760-73341c4cbdfd-secret-metrics-server-client-certs\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.509797 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.509778 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnr65\" (UniqueName: \"kubernetes.io/projected/78d49465-553b-4218-8760-73341c4cbdfd-kube-api-access-tnr65\") pod \"metrics-server-d87dd6979-nnvvv\" (UID: \"78d49465-553b-4218-8760-73341c4cbdfd\") " pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.612827 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.612798 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:35:57.890351 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:57.890323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d87dd6979-nnvvv"] Sep 10 18:35:57.892457 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:35:57.892427 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d49465_553b_4218_8760_73341c4cbdfd.slice/crio-73205b42a02e751d97b4fcf4ffda5beb06fa0dc926321ccd77aac0cb2166ebf7 WatchSource:0}: Error finding container 73205b42a02e751d97b4fcf4ffda5beb06fa0dc926321ccd77aac0cb2166ebf7: Status 404 returned error can't find the container with id 73205b42a02e751d97b4fcf4ffda5beb06fa0dc926321ccd77aac0cb2166ebf7 Sep 10 18:35:58.787298 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:58.787048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"ed3769b6d39819388e38bbc7f173771f27858656c7fe42beef70a0a7c0ed842f"} Sep 10 18:35:58.787298 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:58.787244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"bd888dbc09ef13c2774e48787d5c7f505e986f300a643afb36ed6cf241456ac1"} Sep 10 18:35:58.790239 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:58.790208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" event={"ID":"78d49465-553b-4218-8760-73341c4cbdfd","Type":"ContainerStarted","Data":"73205b42a02e751d97b4fcf4ffda5beb06fa0dc926321ccd77aac0cb2166ebf7"} Sep 10 18:35:59.401219 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:35:59.401153 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-72vfr" podUID="b7909b9f-509e-44dd-bee7-26c83608452c" Sep 10 18:35:59.796120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:59.796089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"17b478d24d85596b09be27775586498938035eba5c9431c8780a2a5b142f961b"} Sep 10 18:35:59.796218 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:35:59.796129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:00.803429 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.803390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"4a39e42b9b8a5deb4248507cb0c8a833936de2e174d530574896575755b747d0"} Sep 10 18:36:00.803881 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.803490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"b34e15b65d0b28cce7ed6af7f433b01aab049ebb50e4a27558b2eaed7d7f7c67"} Sep 10 18:36:00.803881 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.803533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" event={"ID":"523c3e35-bbb7-41e6-a871-73a7e399a739","Type":"ContainerStarted","Data":"785b06916bee6528c06c7dac2a59e21227db29c042ab4d6590367435a56fe69b"} Sep 10 18:36:00.803881 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.803582 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:36:00.805213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.805186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" event={"ID":"78d49465-553b-4218-8760-73341c4cbdfd","Type":"ContainerStarted","Data":"4bfca3015b7f412af522e0a745fbcd62a7154a2ef6e058fa20547da7f18eca53"} Sep 10 18:36:00.826480 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.826415 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" podStartSLOduration=2.664961229 podStartE2EDuration="5.82640075s" totalImagesPullingTime="3.161439521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:36:00.824821323 +0000 UTC m=+284.658136944" watchObservedRunningTime="2026-09-10 18:36:00.82640075 +0000 UTC m=+284.659716371" Sep 10 18:36:00.840851 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:00.840808 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" podStartSLOduration=1.957486844 podStartE2EDuration="3.840793757s" totalImagesPullingTime="1.883306913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:36:00.840334728 +0000 UTC m=+284.673650302" watchObservedRunningTime="2026-09-10 18:36:00.840793757 +0000 UTC m=+284.674109331" Sep 10 18:36:02.543339 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:02.543302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:02.545647 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:02.545626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7909b9f-509e-44dd-bee7-26c83608452c-metrics-tls\") pod \"dns-default-72vfr\" (UID: \"b7909b9f-509e-44dd-bee7-26c83608452c\") " pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:02.799638 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:02.799567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4lj58\"" Sep 10 18:36:02.807289 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:02.807272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:03.077043 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.076920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-72vfr"] Sep 10 18:36:03.079677 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:36:03.079648 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7909b9f_509e_44dd_bee7_26c83608452c.slice/crio-eb0a41e6172df467dca3a3de47f5d69e53f2ce4de8b416b51937d1ae8172f74d WatchSource:0}: Error finding container eb0a41e6172df467dca3a3de47f5d69e53f2ce4de8b416b51937d1ae8172f74d: Status 404 returned error can't find the container with id eb0a41e6172df467dca3a3de47f5d69e53f2ce4de8b416b51937d1ae8172f74d Sep 10 18:36:03.762893 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.762850 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:03.766333 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.766302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.769086 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.769034 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 18:36:03.769086 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.769050 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x6j96\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770400 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770509 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770517 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770572 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 18:36:03.770789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.770661 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 18:36:03.777097 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.777075 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:03.817804 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.817778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-72vfr" event={"ID":"b7909b9f-509e-44dd-bee7-26c83608452c","Type":"ContainerStarted","Data":"eb0a41e6172df467dca3a3de47f5d69e53f2ce4de8b416b51937d1ae8172f74d"} Sep 10 18:36:03.854083 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.854200 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.854200 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.854200 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.854341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.854341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.854292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56jsp\" (UniqueName: \"kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955433 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955433 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955336 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955540 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56jsp\" (UniqueName: \"kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.955589 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.955568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.956097 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.956071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.956201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.956127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.956201 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.956154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.958472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.958452 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.958575 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.958496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:03.963575 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:03.963555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56jsp\" (UniqueName: \"kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp\") pod \"console-79445876d-crq8p\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:04.078377 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:04.078350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:04.355174 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:04.355103 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:04.729800 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:36:04.729735 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddd63f1_1726_4b61_bc1f_3d067ebce899.slice/crio-e96668cbed53cb2bcda30304f6848b8178270cc2f1a70863a2f8882194207e0b WatchSource:0}: Error finding container e96668cbed53cb2bcda30304f6848b8178270cc2f1a70863a2f8882194207e0b: Status 404 returned error can't find the container with id e96668cbed53cb2bcda30304f6848b8178270cc2f1a70863a2f8882194207e0b Sep 10 18:36:04.826219 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:04.826192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79445876d-crq8p" event={"ID":"4ddd63f1-1726-4b61-bc1f-3d067ebce899","Type":"ContainerStarted","Data":"e96668cbed53cb2bcda30304f6848b8178270cc2f1a70863a2f8882194207e0b"} Sep 10 18:36:05.831906 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:05.831874 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-72vfr" event={"ID":"b7909b9f-509e-44dd-bee7-26c83608452c","Type":"ContainerStarted","Data":"af63313edd52d982c929ac260496d8af254914facca48c3699f7e3ed1df7e8a7"} Sep 10 18:36:05.832302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:05.831922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-72vfr" event={"ID":"b7909b9f-509e-44dd-bee7-26c83608452c","Type":"ContainerStarted","Data":"d9a86fded00216a107fe9f387ffab0bf7e268164d864ed5a1955945bf98bddc8"} Sep 10 18:36:05.832302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:05.832006 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:05.848757 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:05.848705 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-72vfr" podStartSLOduration=252.154139077 podStartE2EDuration="4m13.848691863s" totalImagesPullingTime="1.694552786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:36:05.847441365 +0000 UTC m=+289.680756951" watchObservedRunningTime="2026-09-10 18:36:05.848691863 +0000 UTC m=+289.682007437" Sep 10 18:36:06.817464 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:06.817434 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b99b895f-mvkp5" Sep 10 18:36:08.846765 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:08.846727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79445876d-crq8p" event={"ID":"4ddd63f1-1726-4b61-bc1f-3d067ebce899","Type":"ContainerStarted","Data":"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e"} Sep 10 18:36:08.863528 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:08.863459 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79445876d-crq8p" podStartSLOduration=2.601520679 podStartE2EDuration="5.863443117s" totalImagesPullingTime="3.261922438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:36:08.861726263 +0000 UTC m=+292.695041838" watchObservedRunningTime="2026-09-10 18:36:08.863443117 +0000 UTC m=+292.696758692" Sep 10 18:36:12.541430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.541387 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:36:12.545015 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.544985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.558879 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.558820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:36:12.562476 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.562421 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 18:36:12.628334 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628423 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628423 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgd49\" (UniqueName: \"kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628506 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628506 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628572 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.628572 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.628550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.728975 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.728946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729105 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.728993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729105 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729105 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgd49\" (UniqueName: \"kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729264 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729264 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729264 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.729940 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729911 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.730036 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.729949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.730036 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.730006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.730144 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.730007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.731768 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.731731 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.731919 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.731899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.736568 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.736545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgd49\" (UniqueName: \"kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49\") pod \"console-7c79cdbf7f-fslss\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:12.858545 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:12.858520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:13.129884 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:13.129861 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:36:13.131805 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:36:13.131774 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9a2a05_a0d1_47d0_a2fa_02ebdf521a90.slice/crio-bfe8141942083da62cf0792fe1cb593a9fae71aa0a1f3145554dbacfe4acc819 WatchSource:0}: Error finding container bfe8141942083da62cf0792fe1cb593a9fae71aa0a1f3145554dbacfe4acc819: Status 404 returned error can't find the container with id bfe8141942083da62cf0792fe1cb593a9fae71aa0a1f3145554dbacfe4acc819 Sep 10 18:36:13.692317 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:36:13.692269 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rh4jl" podUID="6ec1c3fe-2dd8-48df-b3fe-322ee22f714a" Sep 10 18:36:13.866447 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:13.866415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79cdbf7f-fslss" event={"ID":"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90","Type":"ContainerStarted","Data":"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6"} Sep 10 18:36:13.866594 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:13.866461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79cdbf7f-fslss" event={"ID":"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90","Type":"ContainerStarted","Data":"bfe8141942083da62cf0792fe1cb593a9fae71aa0a1f3145554dbacfe4acc819"} Sep 10 18:36:13.884026 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:13.883983 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c79cdbf7f-fslss" podStartSLOduration=1.883970388 podStartE2EDuration="1.883970388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:36:13.88248815 +0000 UTC m=+297.715803724" watchObservedRunningTime="2026-09-10 18:36:13.883970388 +0000 UTC m=+297.717285966" Sep 10 18:36:14.078671 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:14.078648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:14.078768 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:14.078696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:14.083552 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:14.083529 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:14.874642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:14.874613 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:15.839489 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:15.839450 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-72vfr" Sep 10 18:36:16.611632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:16.611601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:36:16.612437 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:16.612414 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:36:16.614904 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:16.614882 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 18:36:17.613357 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:17.613323 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:36:17.615700 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:17.613379 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:36:22.858923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:22.858887 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:22.859332 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:22.858945 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:22.863458 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:22.863437 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:22.913507 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:22.913486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:36:22.984464 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:22.984438 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:28.695143 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:28.695108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:36:37.618317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:37.618290 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:36:37.622270 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:37.622249 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d87dd6979-nnvvv" Sep 10 18:36:42.984251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:42.984217 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a22b7a8-59d7-4760-a946-46cfb89023fe" containerID="0a1e0d0863e59c1ce35b9ae195547540107019f076e4dfbe773ac10cbfa56446" exitCode=0 Sep 10 18:36:42.984637 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:42.984264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" event={"ID":"2a22b7a8-59d7-4760-a946-46cfb89023fe","Type":"ContainerDied","Data":"0a1e0d0863e59c1ce35b9ae195547540107019f076e4dfbe773ac10cbfa56446"} Sep 10 18:36:42.984637 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:42.984575 2579 scope.go:117] "RemoveContainer" containerID="0a1e0d0863e59c1ce35b9ae195547540107019f076e4dfbe773ac10cbfa56446" Sep 10 18:36:43.989880 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:43.989848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-k5xkt" event={"ID":"2a22b7a8-59d7-4760-a946-46cfb89023fe","Type":"ContainerStarted","Data":"7f06b54e5abdbfc8bfbc92f30598107c5303cebcd6ced74f62c8a37a2d9b3068"} Sep 10 18:36:44.337744 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:44.337715 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f8rtw_5dbfad1a-734c-497e-bd8b-fa4326c5d24a/node-ca/0.log" Sep 10 18:36:44.738629 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:44.738563 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55f66b6d-slj2l_318e4e83-d575-4bd1-9a2e-76bf5be2b47a/router/0.log" Sep 10 18:36:44.938382 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:44.938336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sdjc_dce5b0a7-24c2-434f-bc84-e9c4b3842545/serve-healthcheck-canary/0.log" Sep 10 18:36:48.008541 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.008469 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79445876d-crq8p" podUID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" containerName="console" containerID="cri-o://f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e" gracePeriod=15 Sep 10 18:36:48.248100 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.248074 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:48.315642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315568 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56jsp\" (UniqueName: \"kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.315642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.315642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315623 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.315862 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315761 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.315862 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315801 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.315862 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.315859 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca\") pod \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\" (UID: \"4ddd63f1-1726-4b61-bc1f-3d067ebce899\") " Sep 10 18:36:48.316089 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.316025 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:36:48.316257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.316225 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:48.316317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.316267 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config" (OuterVolumeSpecName: "console-config") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:36:48.316317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.316290 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:36:48.317935 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.317910 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp" (OuterVolumeSpecName: "kube-api-access-56jsp") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "kube-api-access-56jsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:36:48.318183 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.318166 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:36:48.318252 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.318233 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ddd63f1-1726-4b61-bc1f-3d067ebce899" (UID: "4ddd63f1-1726-4b61-bc1f-3d067ebce899"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:36:48.417366 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.417333 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56jsp\" (UniqueName: \"kubernetes.io/projected/4ddd63f1-1726-4b61-bc1f-3d067ebce899-kube-api-access-56jsp\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:48.417366 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.417364 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:48.417366 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.417373 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:48.417520 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.417381 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:48.417520 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:48.417390 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd63f1-1726-4b61-bc1f-3d067ebce899-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:36:49.010927 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.010841 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" containerID="f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e" exitCode=0 Sep 10 18:36:49.010927 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.010906 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79445876d-crq8p" Sep 10 18:36:49.011426 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.010926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79445876d-crq8p" event={"ID":"4ddd63f1-1726-4b61-bc1f-3d067ebce899","Type":"ContainerDied","Data":"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e"} Sep 10 18:36:49.011426 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.010972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79445876d-crq8p" event={"ID":"4ddd63f1-1726-4b61-bc1f-3d067ebce899","Type":"ContainerDied","Data":"e96668cbed53cb2bcda30304f6848b8178270cc2f1a70863a2f8882194207e0b"} Sep 10 18:36:49.011426 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.010995 2579 scope.go:117] "RemoveContainer" containerID="f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e" Sep 10 18:36:49.019391 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.019373 2579 scope.go:117] "RemoveContainer" containerID="f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e" Sep 10 18:36:49.019693 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:36:49.019667 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e\": container with ID starting with f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e not found: ID does not exist" containerID="f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e" Sep 10 18:36:49.019745 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.019703 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e"} err="failed to get container status \"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e\": rpc error: code = NotFound desc = could not find container \"f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e\": container with ID starting with f9b45ffb8ade4d73e61cd3926ae9dcb94373e48ea26925c9c666891d00cb414e not found: ID does not exist" Sep 10 18:36:49.029317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.029293 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:49.035067 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:49.035038 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79445876d-crq8p"] Sep 10 18:36:50.695759 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:36:50.695708 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" path="/var/lib/kubelet/pods/4ddd63f1-1726-4b61-bc1f-3d067ebce899/volumes" Sep 10 18:37:20.880718 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.880685 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:37:20.881191 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.881017 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" containerName="console" Sep 10 18:37:20.881191 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.881030 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" containerName="console" Sep 10 18:37:20.881191 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.881097 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ddd63f1-1726-4b61-bc1f-3d067ebce899" containerName="console" Sep 10 18:37:20.885362 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.885341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.895574 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.895549 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:37:20.999527 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:20.999829 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:20.999747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6q2\" (UniqueName: \"kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100451 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100451 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100451 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100451 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100634 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6q2\" (UniqueName: \"kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.100634 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.100496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.101271 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.101242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.101411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.101272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.101411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.101249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.101411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.101242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.102980 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.102948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.103081 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.103038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.110512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.110492 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6q2\" (UniqueName: \"kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2\") pod \"console-757cf7cd6f-jghlh\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.195040 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.194961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:21.464052 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:21.463977 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:37:21.466998 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:37:21.466971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8812ab6a_3b7c_4ce1_930e_274d781aafef.slice/crio-c6d655d8fa03eb25dc00eb42ad8f93ebabbe9abfc8c7d464cc18acd6f16e033a WatchSource:0}: Error finding container c6d655d8fa03eb25dc00eb42ad8f93ebabbe9abfc8c7d464cc18acd6f16e033a: Status 404 returned error can't find the container with id c6d655d8fa03eb25dc00eb42ad8f93ebabbe9abfc8c7d464cc18acd6f16e033a Sep 10 18:37:22.162763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:22.162723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757cf7cd6f-jghlh" event={"ID":"8812ab6a-3b7c-4ce1-930e-274d781aafef","Type":"ContainerStarted","Data":"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25"} Sep 10 18:37:22.163199 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:22.162783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757cf7cd6f-jghlh" event={"ID":"8812ab6a-3b7c-4ce1-930e-274d781aafef","Type":"ContainerStarted","Data":"c6d655d8fa03eb25dc00eb42ad8f93ebabbe9abfc8c7d464cc18acd6f16e033a"} Sep 10 18:37:22.179568 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:22.179516 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-757cf7cd6f-jghlh" podStartSLOduration=2.179499006 podStartE2EDuration="2.179499006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:37:22.178576666 +0000 UTC m=+366.011892242" watchObservedRunningTime="2026-09-10 18:37:22.179499006 +0000 UTC m=+366.012814581" Sep 10 18:37:29.566689 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.566642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:37:29.569236 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.569211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec1c3fe-2dd8-48df-b3fe-322ee22f714a-metrics-certs\") pod \"network-metrics-daemon-rh4jl\" (UID: \"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a\") " pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:37:29.598961 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.598936 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thvkz\"" Sep 10 18:37:29.607318 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.607298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh4jl" Sep 10 18:37:29.893549 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.893524 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh4jl"] Sep 10 18:37:29.895983 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:37:29.895947 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec1c3fe_2dd8_48df_b3fe_322ee22f714a.slice/crio-1602a0d5c9e509063c0e518f39ddda6868ae04cf69af7bf25852e2598f7118e4 WatchSource:0}: Error finding container 1602a0d5c9e509063c0e518f39ddda6868ae04cf69af7bf25852e2598f7118e4: Status 404 returned error can't find the container with id 1602a0d5c9e509063c0e518f39ddda6868ae04cf69af7bf25852e2598f7118e4 Sep 10 18:37:29.897983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:29.897967 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 18:37:30.198325 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:30.198255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh4jl" event={"ID":"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a","Type":"ContainerStarted","Data":"1602a0d5c9e509063c0e518f39ddda6868ae04cf69af7bf25852e2598f7118e4"} Sep 10 18:37:31.195972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.195940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:31.196396 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.196113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:31.200935 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.200906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:31.205635 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.205605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh4jl" event={"ID":"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a","Type":"ContainerStarted","Data":"a7defe1b89e8c46cb0a55d5d15475e75da64ccd6db44303adb1da5e852a3bf87"} Sep 10 18:37:31.205760 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.205654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh4jl" event={"ID":"6ec1c3fe-2dd8-48df-b3fe-322ee22f714a","Type":"ContainerStarted","Data":"2250162bb25a62bef93cb73eed4ee086777744333af55262ae4dbc7432be08be"} Sep 10 18:37:31.209268 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.209246 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:37:31.233909 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.233854 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rh4jl" podStartSLOduration=373.404388369 podStartE2EDuration="6m14.233830908s" totalImagesPullingTime="829.442539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:37:31.231987423 +0000 UTC m=+375.065302998" watchObservedRunningTime="2026-09-10 18:37:31.233830908 +0000 UTC m=+375.067146484" Sep 10 18:37:31.280316 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:31.280274 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:37:56.311823 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.311761 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c79cdbf7f-fslss" podUID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" containerName="console" containerID="cri-o://90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6" gracePeriod=15 Sep 10 18:37:56.550368 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.550347 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:37:56.594746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594720 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.594865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594754 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.594865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594778 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.594865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.594865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594826 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.594865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594853 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.595145 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.594989 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgd49\" (UniqueName: \"kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49\") pod \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\" (UID: \"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90\") " Sep 10 18:37:56.595213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595184 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:37:56.595213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595204 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:37:56.595309 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595245 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config" (OuterVolumeSpecName: "console-config") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:37:56.595309 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595254 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:37:56.595406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595364 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-trusted-ca-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.595406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595381 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.595406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595391 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.595406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.595401 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.596908 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.596883 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:37:56.597001 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.596947 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:37:56.597001 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.596971 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49" (OuterVolumeSpecName: "kube-api-access-bgd49") pod "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" (UID: "cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90"). InnerVolumeSpecName "kube-api-access-bgd49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:37:56.695736 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.695715 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.695736 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.695735 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgd49\" (UniqueName: \"kubernetes.io/projected/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-kube-api-access-bgd49\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:56.695853 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:56.695746 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:37:57.307630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.307597 2579 generic.go:356] "Generic (PLEG): container finished" podID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" containerID="90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6" exitCode=0 Sep 10 18:37:57.307762 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.307650 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79cdbf7f-fslss" Sep 10 18:37:57.307762 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.307648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79cdbf7f-fslss" event={"ID":"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90","Type":"ContainerDied","Data":"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6"} Sep 10 18:37:57.307833 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.307785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79cdbf7f-fslss" event={"ID":"cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90","Type":"ContainerDied","Data":"bfe8141942083da62cf0792fe1cb593a9fae71aa0a1f3145554dbacfe4acc819"} Sep 10 18:37:57.307833 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.307815 2579 scope.go:117] "RemoveContainer" containerID="90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6" Sep 10 18:37:57.316851 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.316667 2579 scope.go:117] "RemoveContainer" containerID="90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6" Sep 10 18:37:57.317094 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:37:57.316997 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6\": container with ID starting with 90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6 not found: ID does not exist" containerID="90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6" Sep 10 18:37:57.317094 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.317019 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6"} err="failed to get container status \"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6\": rpc error: code = NotFound desc = could not find container \"90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6\": container with ID starting with 90bdefbca564cd1f0e2dcaa3f2ce281b60e501a64a7fb592c2bfd429ecf64da6 not found: ID does not exist" Sep 10 18:37:57.324213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.324188 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:37:57.326878 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:57.326848 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c79cdbf7f-fslss"] Sep 10 18:37:58.695857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:37:58.695823 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" path="/var/lib/kubelet/pods/cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90/volumes" Sep 10 18:38:53.450735 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.450651 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:38:53.451287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.450967 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" containerName="console" Sep 10 18:38:53.451287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.450980 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" containerName="console" Sep 10 18:38:53.451287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.451028 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9a2a05-a0d1-47d0-a2fa-02ebdf521a90" containerName="console" Sep 10 18:38:53.453923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.453903 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.464742 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.464715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:38:53.552111 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hggt\" (UniqueName: \"kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552471 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.552471 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.552366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653792 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hggt\" (UniqueName: \"kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.653979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.653929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.654303 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.654012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.654676 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.654653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.654676 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.654660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.654799 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.654676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.654799 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.654761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.656469 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.656441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.656550 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.656529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.661507 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.661477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hggt\" (UniqueName: \"kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt\") pod \"console-786c5448fb-542kg\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:53.764878 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:53.764793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:38:54.033885 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:54.033859 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:38:54.036012 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:38:54.035980 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a245f81_0547_41cf_bdd8_eb33d45b0b51.slice/crio-a9aa970305f208b2e0b654ce88f82d5911bf4040af7dedda369ac182ab55e2f5 WatchSource:0}: Error finding container a9aa970305f208b2e0b654ce88f82d5911bf4040af7dedda369ac182ab55e2f5: Status 404 returned error can't find the container with id a9aa970305f208b2e0b654ce88f82d5911bf4040af7dedda369ac182ab55e2f5 Sep 10 18:38:54.531217 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:54.531173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c5448fb-542kg" event={"ID":"6a245f81-0547-41cf-bdd8-eb33d45b0b51","Type":"ContainerStarted","Data":"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168"} Sep 10 18:38:54.531633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:54.531237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c5448fb-542kg" event={"ID":"6a245f81-0547-41cf-bdd8-eb33d45b0b51","Type":"ContainerStarted","Data":"a9aa970305f208b2e0b654ce88f82d5911bf4040af7dedda369ac182ab55e2f5"} Sep 10 18:38:54.550925 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:38:54.550854 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786c5448fb-542kg" podStartSLOduration=1.550827036 podStartE2EDuration="1.550827036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:38:54.547524392 +0000 UTC m=+458.380839967" watchObservedRunningTime="2026-09-10 18:38:54.550827036 +0000 UTC m=+458.384142615" Sep 10 18:39:03.765372 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:03.765329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:39:03.765950 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:03.765408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:39:03.769820 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:03.769794 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:39:04.574009 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:04.573981 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:39:04.614002 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:04.613958 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:39:29.639749 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:29.639709 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-757cf7cd6f-jghlh" podUID="8812ab6a-3b7c-4ce1-930e-274d781aafef" containerName="console" containerID="cri-o://62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25" gracePeriod=15 Sep 10 18:39:29.887507 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:29.887481 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:39:30.062461 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062354 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062461 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062403 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062461 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062459 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062744 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062485 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062744 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062638 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062744 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062682 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.062908 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.062749 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs6q2\" (UniqueName: \"kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2\") pod \"8812ab6a-3b7c-4ce1-930e-274d781aafef\" (UID: \"8812ab6a-3b7c-4ce1-930e-274d781aafef\") " Sep 10 18:39:30.063026 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.063003 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca" (OuterVolumeSpecName: "service-ca") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:39:30.063111 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.063043 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:39:30.063151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.063100 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:39:30.063151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.063124 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config" (OuterVolumeSpecName: "console-config") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:39:30.064699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.064670 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:39:30.064699 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.064689 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:39:30.065009 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.064849 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2" (OuterVolumeSpecName: "kube-api-access-xs6q2") pod "8812ab6a-3b7c-4ce1-930e-274d781aafef" (UID: "8812ab6a-3b7c-4ce1-930e-274d781aafef"). InnerVolumeSpecName "kube-api-access-xs6q2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:39:30.163921 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163885 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.163921 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163916 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.163921 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163926 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-trusted-ca-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.164189 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163935 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.164189 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163943 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs6q2\" (UniqueName: \"kubernetes.io/projected/8812ab6a-3b7c-4ce1-930e-274d781aafef-kube-api-access-xs6q2\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.164189 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163952 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.164189 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.163960 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8812ab6a-3b7c-4ce1-930e-274d781aafef-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:30.673225 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.673188 2579 generic.go:356] "Generic (PLEG): container finished" podID="8812ab6a-3b7c-4ce1-930e-274d781aafef" containerID="62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25" exitCode=0 Sep 10 18:39:30.673632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.673237 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757cf7cd6f-jghlh" Sep 10 18:39:30.673632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.673240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757cf7cd6f-jghlh" event={"ID":"8812ab6a-3b7c-4ce1-930e-274d781aafef","Type":"ContainerDied","Data":"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25"} Sep 10 18:39:30.673632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.673294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757cf7cd6f-jghlh" event={"ID":"8812ab6a-3b7c-4ce1-930e-274d781aafef","Type":"ContainerDied","Data":"c6d655d8fa03eb25dc00eb42ad8f93ebabbe9abfc8c7d464cc18acd6f16e033a"} Sep 10 18:39:30.673632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.673315 2579 scope.go:117] "RemoveContainer" containerID="62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25" Sep 10 18:39:30.682428 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.682408 2579 scope.go:117] "RemoveContainer" containerID="62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25" Sep 10 18:39:30.682692 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:39:30.682673 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25\": container with ID starting with 62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25 not found: ID does not exist" containerID="62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25" Sep 10 18:39:30.682754 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.682699 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25"} err="failed to get container status \"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25\": rpc error: code = NotFound desc = could not find container \"62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25\": container with ID starting with 62250716b2016bb9923a9a415a2765c4f94aacccb731bf41328b6a112c21dc25 not found: ID does not exist" Sep 10 18:39:30.696748 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.696636 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:39:30.698022 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:30.698000 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-757cf7cd6f-jghlh"] Sep 10 18:39:32.695273 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:32.695227 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8812ab6a-3b7c-4ce1-930e-274d781aafef" path="/var/lib/kubelet/pods/8812ab6a-3b7c-4ce1-930e-274d781aafef/volumes" Sep 10 18:39:38.852717 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.852678 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx"] Sep 10 18:39:38.853193 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.853013 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8812ab6a-3b7c-4ce1-930e-274d781aafef" containerName="console" Sep 10 18:39:38.853193 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.853025 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8812ab6a-3b7c-4ce1-930e-274d781aafef" containerName="console" Sep 10 18:39:38.853193 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.853091 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8812ab6a-3b7c-4ce1-930e-274d781aafef" containerName="console" Sep 10 18:39:38.857732 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.857711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:38.860511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.860488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 18:39:38.860634 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.860488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lhgtj\"" Sep 10 18:39:38.860634 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.860524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 18:39:38.865867 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:38.865841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx"] Sep 10 18:39:39.040864 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.040822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.040864 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.040869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcljp\" (UniqueName: \"kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.041103 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.040895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.141690 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.141614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.141690 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.141658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcljp\" (UniqueName: \"kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.141690 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.141678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.141989 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.141975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.142103 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.142084 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.150204 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.150177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcljp\" (UniqueName: \"kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.167986 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.167957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:39.436467 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.436403 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx"] Sep 10 18:39:39.438687 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:39:39.438658 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f270b6_30d0_4c24_ad78_7044ddd48ed9.slice/crio-43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef WatchSource:0}: Error finding container 43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef: Status 404 returned error can't find the container with id 43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef Sep 10 18:39:39.713155 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:39.713052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" event={"ID":"85f270b6-30d0-4c24-ad78-7044ddd48ed9","Type":"ContainerStarted","Data":"43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef"} Sep 10 18:39:47.748216 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:47.748176 2579 generic.go:356] "Generic (PLEG): container finished" podID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerID="ffdf80cdb5e3678a685b6ab31bf0797e31b16465b8454b4cad53ac28fec60fdc" exitCode=0 Sep 10 18:39:47.748665 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:47.748260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" event={"ID":"85f270b6-30d0-4c24-ad78-7044ddd48ed9","Type":"ContainerDied","Data":"ffdf80cdb5e3678a685b6ab31bf0797e31b16465b8454b4cad53ac28fec60fdc"} Sep 10 18:39:50.761864 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:50.761831 2579 generic.go:356] "Generic (PLEG): container finished" podID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerID="d2d891c4db94763ce4b20b32a4c2e971078fb06f135d51c6e60e25a671896ee7" exitCode=0 Sep 10 18:39:50.762357 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:50.761871 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" event={"ID":"85f270b6-30d0-4c24-ad78-7044ddd48ed9","Type":"ContainerDied","Data":"d2d891c4db94763ce4b20b32a4c2e971078fb06f135d51c6e60e25a671896ee7"} Sep 10 18:39:57.794331 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:57.794232 2579 generic.go:356] "Generic (PLEG): container finished" podID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerID="d3d7374f8e78acc9d8b25bed4707b84531bf75d1aacc2e08408a1f65f764e4e6" exitCode=0 Sep 10 18:39:57.794331 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:57.794310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" event={"ID":"85f270b6-30d0-4c24-ad78-7044ddd48ed9","Type":"ContainerDied","Data":"d3d7374f8e78acc9d8b25bed4707b84531bf75d1aacc2e08408a1f65f764e4e6"} Sep 10 18:39:58.930598 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:58.930572 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:59.000120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.000077 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util\") pod \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " Sep 10 18:39:59.000287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.000146 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle\") pod \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " Sep 10 18:39:59.000287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.000190 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcljp\" (UniqueName: \"kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp\") pod \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\" (UID: \"85f270b6-30d0-4c24-ad78-7044ddd48ed9\") " Sep 10 18:39:59.000893 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.000869 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle" (OuterVolumeSpecName: "bundle") pod "85f270b6-30d0-4c24-ad78-7044ddd48ed9" (UID: "85f270b6-30d0-4c24-ad78-7044ddd48ed9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:39:59.002409 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.002387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp" (OuterVolumeSpecName: "kube-api-access-rcljp") pod "85f270b6-30d0-4c24-ad78-7044ddd48ed9" (UID: "85f270b6-30d0-4c24-ad78-7044ddd48ed9"). InnerVolumeSpecName "kube-api-access-rcljp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:39:59.005597 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.005555 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util" (OuterVolumeSpecName: "util") pod "85f270b6-30d0-4c24-ad78-7044ddd48ed9" (UID: "85f270b6-30d0-4c24-ad78-7044ddd48ed9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:39:59.101245 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.101210 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:59.101245 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.101239 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f270b6-30d0-4c24-ad78-7044ddd48ed9-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:59.101245 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.101248 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcljp\" (UniqueName: \"kubernetes.io/projected/85f270b6-30d0-4c24-ad78-7044ddd48ed9-kube-api-access-rcljp\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:39:59.804340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.804313 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" Sep 10 18:39:59.804340 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.804326 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c6tbx" event={"ID":"85f270b6-30d0-4c24-ad78-7044ddd48ed9","Type":"ContainerDied","Data":"43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef"} Sep 10 18:39:59.804565 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:39:59.804367 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43bff94be4fa9f0854ce7454deda7fe015ca423426b6e847655eb3a990cc84ef" Sep 10 18:40:06.786011 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.785970 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx"] Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786406 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="pull" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786423 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="pull" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786462 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="util" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786470 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="util" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786482 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="extract" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786491 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="extract" Sep 10 18:40:06.786608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.786565 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f270b6-30d0-4c24-ad78-7044ddd48ed9" containerName="extract" Sep 10 18:40:06.791150 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.791130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.794001 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.793965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 18:40:06.794148 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.794032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 18:40:06.794148 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.794037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2bpdc\"" Sep 10 18:40:06.798962 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.798937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx"] Sep 10 18:40:06.864972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.864937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1224732f-e06e-41c6-b177-35ba74c34755-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.864972 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.864978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqp7s\" (UniqueName: \"kubernetes.io/projected/1224732f-e06e-41c6-b177-35ba74c34755-kube-api-access-lqp7s\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.966487 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.966440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1224732f-e06e-41c6-b177-35ba74c34755-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.966487 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.966492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqp7s\" (UniqueName: \"kubernetes.io/projected/1224732f-e06e-41c6-b177-35ba74c34755-kube-api-access-lqp7s\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.966844 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.966818 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1224732f-e06e-41c6-b177-35ba74c34755-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:06.975451 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:06.975427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqp7s\" (UniqueName: \"kubernetes.io/projected/1224732f-e06e-41c6-b177-35ba74c34755-kube-api-access-lqp7s\") pod \"cert-manager-operator-controller-manager-55c444bf86-w9lmx\" (UID: \"1224732f-e06e-41c6-b177-35ba74c34755\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:07.100691 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:07.100653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" Sep 10 18:40:07.385018 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:07.384812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx"] Sep 10 18:40:07.387980 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:07.387949 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1224732f_e06e_41c6_b177_35ba74c34755.slice/crio-89da1805c3e6bff421e49ffaf0242e0dfdd8f7a3c21793f3a5e6d67cfd8b7568 WatchSource:0}: Error finding container 89da1805c3e6bff421e49ffaf0242e0dfdd8f7a3c21793f3a5e6d67cfd8b7568: Status 404 returned error can't find the container with id 89da1805c3e6bff421e49ffaf0242e0dfdd8f7a3c21793f3a5e6d67cfd8b7568 Sep 10 18:40:07.837024 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:07.836989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" event={"ID":"1224732f-e06e-41c6-b177-35ba74c34755","Type":"ContainerStarted","Data":"89da1805c3e6bff421e49ffaf0242e0dfdd8f7a3c21793f3a5e6d67cfd8b7568"} Sep 10 18:40:19.887351 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:19.887314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" event={"ID":"1224732f-e06e-41c6-b177-35ba74c34755","Type":"ContainerStarted","Data":"c799a1658302043e05d6877fa0b27187208bf433e30d7d640e405fe0494b3889"} Sep 10 18:40:19.909784 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:19.909723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w9lmx" podStartSLOduration=2.188452304 podStartE2EDuration="13.909703564s" totalImagesPullingTime="11.72125126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:40:19.905926747 +0000 UTC m=+543.739242357" watchObservedRunningTime="2026-09-10 18:40:19.909703564 +0000 UTC m=+543.743019138" Sep 10 18:40:20.134496 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.134468 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wlklj"] Sep 10 18:40:20.137861 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.137819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.140857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.140826 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9mxbv\"" Sep 10 18:40:20.140964 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.140858 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 18:40:20.140964 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.140908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 18:40:20.145737 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.145717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wlklj"] Sep 10 18:40:20.280339 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.280317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.280436 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.280375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnr2s\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-kube-api-access-bnr2s\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.380643 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.380621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnr2s\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-kube-api-access-bnr2s\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.380732 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.380676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.398407 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.398353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.398490 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.398435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnr2s\" (UniqueName: \"kubernetes.io/projected/896fb94b-ff7c-4987-9e6c-326a14db83b6-kube-api-access-bnr2s\") pod \"cert-manager-webhook-6486ffd997-wlklj\" (UID: \"896fb94b-ff7c-4987-9e6c-326a14db83b6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.447387 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.447367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:20.715787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.715765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wlklj"] Sep 10 18:40:20.717212 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:20.717186 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod896fb94b_ff7c_4987_9e6c_326a14db83b6.slice/crio-c7deaae10742a98e4f8c88b714588afd371cb22a73ff53f4f0e7863d55b215f3 WatchSource:0}: Error finding container c7deaae10742a98e4f8c88b714588afd371cb22a73ff53f4f0e7863d55b215f3: Status 404 returned error can't find the container with id c7deaae10742a98e4f8c88b714588afd371cb22a73ff53f4f0e7863d55b215f3 Sep 10 18:40:20.893171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:20.893143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" event={"ID":"896fb94b-ff7c-4987-9e6c-326a14db83b6","Type":"ContainerStarted","Data":"c7deaae10742a98e4f8c88b714588afd371cb22a73ff53f4f0e7863d55b215f3"} Sep 10 18:40:21.680003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.679958 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh"] Sep 10 18:40:21.683754 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.683691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.686697 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.686668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 18:40:21.686840 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.686729 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 18:40:21.688017 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.687997 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lhgtj\"" Sep 10 18:40:21.692125 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.692068 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh"] Sep 10 18:40:21.794094 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.794029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.794313 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.794127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvxx\" (UniqueName: \"kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.794313 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.794182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.894938 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.894903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.895452 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.894988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvxx\" (UniqueName: \"kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.895452 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.895028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.895452 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.895411 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.895452 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.895435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.903867 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.903806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvxx\" (UniqueName: \"kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:21.997368 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:21.997296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:22.277260 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:22.277230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh"] Sep 10 18:40:22.279289 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:22.279260 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd4a33d_5a25_4973_8d1c_a30be661f5f6.slice/crio-241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1 WatchSource:0}: Error finding container 241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1: Status 404 returned error can't find the container with id 241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1 Sep 10 18:40:22.905307 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:22.905254 2579 generic.go:356] "Generic (PLEG): container finished" podID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerID="a7683cb2b9ef34e5757f2253d06d4038e6a6bed39f7e7291db25d72d6f66d4f4" exitCode=0 Sep 10 18:40:22.905716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:22.905358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" event={"ID":"fdd4a33d-5a25-4973-8d1c-a30be661f5f6","Type":"ContainerDied","Data":"a7683cb2b9ef34e5757f2253d06d4038e6a6bed39f7e7291db25d72d6f66d4f4"} Sep 10 18:40:22.905716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:22.905433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" event={"ID":"fdd4a33d-5a25-4973-8d1c-a30be661f5f6","Type":"ContainerStarted","Data":"241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1"} Sep 10 18:40:23.911618 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:23.911576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" event={"ID":"896fb94b-ff7c-4987-9e6c-326a14db83b6","Type":"ContainerStarted","Data":"b6f518825a197956bccc91cd47d88698e992edbcf081f7c99596a7ebd8322a17"} Sep 10 18:40:23.912112 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:23.911647 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:23.927203 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:23.926966 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" podStartSLOduration=1.22515431 podStartE2EDuration="3.926943345s" totalImagesPullingTime="2.701789035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:40:23.92643565 +0000 UTC m=+547.759751226" watchObservedRunningTime="2026-09-10 18:40:23.926943345 +0000 UTC m=+547.760258921" Sep 10 18:40:24.917557 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:24.917523 2579 generic.go:356] "Generic (PLEG): container finished" podID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerID="bc15c6827da3ddf8ab96bed6bae8eedb2e26b1ced3147f6436aadb192cb101b8" exitCode=0 Sep 10 18:40:24.917990 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:24.917610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" event={"ID":"fdd4a33d-5a25-4973-8d1c-a30be661f5f6","Type":"ContainerDied","Data":"bc15c6827da3ddf8ab96bed6bae8eedb2e26b1ced3147f6436aadb192cb101b8"} Sep 10 18:40:25.924908 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:25.924875 2579 generic.go:356] "Generic (PLEG): container finished" podID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerID="25706fe682eab75766b785d5072cf4542bb8a13d5d1091c95add1e3640b5b96f" exitCode=0 Sep 10 18:40:25.925293 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:25.924943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" event={"ID":"fdd4a33d-5a25-4973-8d1c-a30be661f5f6","Type":"ContainerDied","Data":"25706fe682eab75766b785d5072cf4542bb8a13d5d1091c95add1e3640b5b96f"} Sep 10 18:40:26.530519 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.530480 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6"] Sep 10 18:40:26.533768 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.533752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.536412 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.536392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dq569\"" Sep 10 18:40:26.541138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.541115 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6"] Sep 10 18:40:26.638468 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.638431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzf9\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-kube-api-access-xbzf9\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.638661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.638492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.739841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.739800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.740091 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.739885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzf9\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-kube-api-access-xbzf9\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.749940 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.749912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.750186 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.750165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzf9\" (UniqueName: \"kubernetes.io/projected/9f615a0a-d868-4bb5-9075-0fac4ebd9295-kube-api-access-xbzf9\") pod \"cert-manager-cainjector-559cdd8c87-mt6s6\" (UID: \"9f615a0a-d868-4bb5-9075-0fac4ebd9295\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:26.843350 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:26.843318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" Sep 10 18:40:27.054230 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.054202 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:27.111563 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.111484 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6"] Sep 10 18:40:27.114887 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:27.114855 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f615a0a_d868_4bb5_9075_0fac4ebd9295.slice/crio-6bf99202903b599307a820540c0e8bbd14e9233af18f0929f045b04b73bbde92 WatchSource:0}: Error finding container 6bf99202903b599307a820540c0e8bbd14e9233af18f0929f045b04b73bbde92: Status 404 returned error can't find the container with id 6bf99202903b599307a820540c0e8bbd14e9233af18f0929f045b04b73bbde92 Sep 10 18:40:27.143933 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.143896 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle\") pod \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " Sep 10 18:40:27.144038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.143942 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqvxx\" (UniqueName: \"kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx\") pod \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " Sep 10 18:40:27.144100 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.144051 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util\") pod \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\" (UID: \"fdd4a33d-5a25-4973-8d1c-a30be661f5f6\") " Sep 10 18:40:27.144383 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.144355 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle" (OuterVolumeSpecName: "bundle") pod "fdd4a33d-5a25-4973-8d1c-a30be661f5f6" (UID: "fdd4a33d-5a25-4973-8d1c-a30be661f5f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:27.145904 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.145883 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx" (OuterVolumeSpecName: "kube-api-access-bqvxx") pod "fdd4a33d-5a25-4973-8d1c-a30be661f5f6" (UID: "fdd4a33d-5a25-4973-8d1c-a30be661f5f6"). InnerVolumeSpecName "kube-api-access-bqvxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:40:27.150014 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.149988 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util" (OuterVolumeSpecName: "util") pod "fdd4a33d-5a25-4973-8d1c-a30be661f5f6" (UID: "fdd4a33d-5a25-4973-8d1c-a30be661f5f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:27.244923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.244891 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:27.244923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.244920 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:27.244923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.244930 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqvxx\" (UniqueName: \"kubernetes.io/projected/fdd4a33d-5a25-4973-8d1c-a30be661f5f6-kube-api-access-bqvxx\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:27.935130 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.935093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" event={"ID":"9f615a0a-d868-4bb5-9075-0fac4ebd9295","Type":"ContainerStarted","Data":"99f1644a4cc4c62c511ace53870685491affe5588cf463ebc308d5219a75dab3"} Sep 10 18:40:27.935305 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.935140 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" event={"ID":"9f615a0a-d868-4bb5-9075-0fac4ebd9295","Type":"ContainerStarted","Data":"6bf99202903b599307a820540c0e8bbd14e9233af18f0929f045b04b73bbde92"} Sep 10 18:40:27.936963 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.936933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" event={"ID":"fdd4a33d-5a25-4973-8d1c-a30be661f5f6","Type":"ContainerDied","Data":"241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1"} Sep 10 18:40:27.937087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.936965 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fq8jsh" Sep 10 18:40:27.937087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.936975 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="241a2866c27e47d8cdc58bf269b25b7ef71426926c8109b89fd24c261a173bf1" Sep 10 18:40:27.950381 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:27.950334 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mt6s6" podStartSLOduration=1.950318362 podStartE2EDuration="1.950318362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:40:27.949148516 +0000 UTC m=+551.782464090" watchObservedRunningTime="2026-09-10 18:40:27.950318362 +0000 UTC m=+551.783633936" Sep 10 18:40:29.920743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:29.920712 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wlklj" Sep 10 18:40:43.275038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275002 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q"] Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275333 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="pull" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275345 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="pull" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275357 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="util" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275362 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="util" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275372 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="extract" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275377 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="extract" Sep 10 18:40:43.275511 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.275439 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd4a33d-5a25-4973-8d1c-a30be661f5f6" containerName="extract" Sep 10 18:40:43.278563 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.278545 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.281142 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.281122 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 18:40:43.281282 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.281265 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 18:40:43.282424 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.282409 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lhgtj\"" Sep 10 18:40:43.288573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.288550 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q"] Sep 10 18:40:43.368375 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.368344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wnf\" (UniqueName: \"kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.368554 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.368385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.368554 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.368407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.469657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.469621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.469657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.469666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.469920 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.469783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wnf\" (UniqueName: \"kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.470012 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.469989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.470103 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.470031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.478036 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.478007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wnf\" (UniqueName: \"kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.588897 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.588867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:43.856336 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:43.856309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q"] Sep 10 18:40:43.857997 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:43.857967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d95bd0_7230_46b3_9790_1c84333a88f7.slice/crio-650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb WatchSource:0}: Error finding container 650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb: Status 404 returned error can't find the container with id 650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb Sep 10 18:40:44.012649 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:44.012620 2579 generic.go:356] "Generic (PLEG): container finished" podID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerID="45bfbd022c8a03a749b427d68faa5df79545dd0bd0a7bc64579f8efc2558f565" exitCode=0 Sep 10 18:40:44.012769 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:44.012681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" event={"ID":"c9d95bd0-7230-46b3-9790-1c84333a88f7","Type":"ContainerDied","Data":"45bfbd022c8a03a749b427d68faa5df79545dd0bd0a7bc64579f8efc2558f565"} Sep 10 18:40:44.012769 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:44.012726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" event={"ID":"c9d95bd0-7230-46b3-9790-1c84333a88f7","Type":"ContainerStarted","Data":"650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb"} Sep 10 18:40:45.019780 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:45.019747 2579 generic.go:356] "Generic (PLEG): container finished" podID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerID="09bf57a5f55ae751276e69b0d3c242e9c3ac26795f71836d4d30398763abd8a8" exitCode=0 Sep 10 18:40:45.020121 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:45.019817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" event={"ID":"c9d95bd0-7230-46b3-9790-1c84333a88f7","Type":"ContainerDied","Data":"09bf57a5f55ae751276e69b0d3c242e9c3ac26795f71836d4d30398763abd8a8"} Sep 10 18:40:46.026640 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:46.026605 2579 generic.go:356] "Generic (PLEG): container finished" podID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerID="ba43a1da28f42d4fde36d330768d3dfcb7007561396210a5c792666111adcd0f" exitCode=0 Sep 10 18:40:46.027040 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:46.026691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" event={"ID":"c9d95bd0-7230-46b3-9790-1c84333a88f7","Type":"ContainerDied","Data":"ba43a1da28f42d4fde36d330768d3dfcb7007561396210a5c792666111adcd0f"} Sep 10 18:40:47.155071 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.155035 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:47.198544 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.198524 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle\") pod \"c9d95bd0-7230-46b3-9790-1c84333a88f7\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " Sep 10 18:40:47.198674 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.198549 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util\") pod \"c9d95bd0-7230-46b3-9790-1c84333a88f7\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " Sep 10 18:40:47.198674 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.198582 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9wnf\" (UniqueName: \"kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf\") pod \"c9d95bd0-7230-46b3-9790-1c84333a88f7\" (UID: \"c9d95bd0-7230-46b3-9790-1c84333a88f7\") " Sep 10 18:40:47.199256 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.199231 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle" (OuterVolumeSpecName: "bundle") pod "c9d95bd0-7230-46b3-9790-1c84333a88f7" (UID: "c9d95bd0-7230-46b3-9790-1c84333a88f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:47.200547 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.200529 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf" (OuterVolumeSpecName: "kube-api-access-k9wnf") pod "c9d95bd0-7230-46b3-9790-1c84333a88f7" (UID: "c9d95bd0-7230-46b3-9790-1c84333a88f7"). InnerVolumeSpecName "kube-api-access-k9wnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:40:47.204415 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.204378 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util" (OuterVolumeSpecName: "util") pod "c9d95bd0-7230-46b3-9790-1c84333a88f7" (UID: "c9d95bd0-7230-46b3-9790-1c84333a88f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:47.299814 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.299767 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:47.299814 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.299789 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d95bd0-7230-46b3-9790-1c84333a88f7-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:47.299814 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:47.299797 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9wnf\" (UniqueName: \"kubernetes.io/projected/c9d95bd0-7230-46b3-9790-1c84333a88f7-kube-api-access-k9wnf\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:48.038388 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.038363 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" Sep 10 18:40:48.038534 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.038360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz8q6q" event={"ID":"c9d95bd0-7230-46b3-9790-1c84333a88f7","Type":"ContainerDied","Data":"650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb"} Sep 10 18:40:48.038534 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.038485 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="650ebe3692c5b294c70919639700210f5506b1e78be3438d48a6a6fb9e9272fb" Sep 10 18:40:48.397789 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.397759 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9"] Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398088 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="extract" Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398104 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="extract" Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398120 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="util" Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398126 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="util" Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398147 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="pull" Sep 10 18:40:48.398177 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398155 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="pull" Sep 10 18:40:48.398360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.398236 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d95bd0-7230-46b3-9790-1c84333a88f7" containerName="extract" Sep 10 18:40:48.401378 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.401360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.404332 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 18:40:48.404332 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404252 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 18:40:48.404332 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404299 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 18:40:48.404332 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404301 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bf6pz\"" Sep 10 18:40:48.404597 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 18:40:48.404597 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.404467 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 18:40:48.407924 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.407901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.408021 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.407971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrhgp\" (UniqueName: \"kubernetes.io/projected/30fbf3d2-c835-4267-8720-76b28eb4476c-kube-api-access-hrhgp\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.408095 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.408025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30fbf3d2-c835-4267-8720-76b28eb4476c-manager-config\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.408148 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.408128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-metrics-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.411485 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.411465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9"] Sep 10 18:40:48.509109 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.509082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrhgp\" (UniqueName: \"kubernetes.io/projected/30fbf3d2-c835-4267-8720-76b28eb4476c-kube-api-access-hrhgp\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.509257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.509122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30fbf3d2-c835-4267-8720-76b28eb4476c-manager-config\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.509257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.509154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-metrics-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.509257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.509182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.509705 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.509681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30fbf3d2-c835-4267-8720-76b28eb4476c-manager-config\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.511580 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.511552 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-metrics-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.511712 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.511691 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30fbf3d2-c835-4267-8720-76b28eb4476c-cert\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.524749 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.524722 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrhgp\" (UniqueName: \"kubernetes.io/projected/30fbf3d2-c835-4267-8720-76b28eb4476c-kube-api-access-hrhgp\") pod \"lws-controller-manager-ddb978bf8-vt7q9\" (UID: \"30fbf3d2-c835-4267-8720-76b28eb4476c\") " pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.711117 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.711024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:48.989078 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:48.989018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9"] Sep 10 18:40:48.991332 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:48.991306 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fbf3d2_c835_4267_8720_76b28eb4476c.slice/crio-f07786bcd28d2de88e3564d4d4f92533b608675be79d8769617a6246762cdc07 WatchSource:0}: Error finding container f07786bcd28d2de88e3564d4d4f92533b608675be79d8769617a6246762cdc07: Status 404 returned error can't find the container with id f07786bcd28d2de88e3564d4d4f92533b608675be79d8769617a6246762cdc07 Sep 10 18:40:49.043822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:49.043794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" event={"ID":"30fbf3d2-c835-4267-8720-76b28eb4476c","Type":"ContainerStarted","Data":"f07786bcd28d2de88e3564d4d4f92533b608675be79d8769617a6246762cdc07"} Sep 10 18:40:51.055466 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:51.055428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" event={"ID":"30fbf3d2-c835-4267-8720-76b28eb4476c","Type":"ContainerStarted","Data":"ff29207dcc2a645427232611136f9b1c2de369234d24a90e7cf0a276465a7b65"} Sep 10 18:40:51.055865 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:51.055502 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:40:51.071846 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:51.071788 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" podStartSLOduration=1.694619611 podStartE2EDuration="3.0717726s" totalImagesPullingTime="1.377152989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:40:51.070311247 +0000 UTC m=+574.903626826" watchObservedRunningTime="2026-09-10 18:40:51.0717726 +0000 UTC m=+574.905088216" Sep 10 18:40:53.141180 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.141128 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6"] Sep 10 18:40:53.145003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.144981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.147832 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.147802 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 18:40:53.147969 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.147875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lhgtj\"" Sep 10 18:40:53.149091 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.149073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 18:40:53.156474 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.156450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6"] Sep 10 18:40:53.248030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.247987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.248030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.248029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6vp\" (UniqueName: \"kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.248283 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.248053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.349353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.349320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.349353 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.349355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6vp\" (UniqueName: \"kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.349565 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.349382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.349770 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.349751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.349807 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.349776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.360952 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.360923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6vp\" (UniqueName: \"kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.454923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.454839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:53.725938 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:53.725912 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6"] Sep 10 18:40:53.728590 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:53.728557 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b337e8_4d59_46c0_85d5_a53dfd05b7e8.slice/crio-4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d WatchSource:0}: Error finding container 4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d: Status 404 returned error can't find the container with id 4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d Sep 10 18:40:54.069513 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.069415 2579 generic.go:356] "Generic (PLEG): container finished" podID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerID="b27ff3629d23b644369d4aeb1528f41b06b5587953392fbc75ae9b48a38a4dc0" exitCode=0 Sep 10 18:40:54.069513 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.069499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" event={"ID":"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8","Type":"ContainerDied","Data":"b27ff3629d23b644369d4aeb1528f41b06b5587953392fbc75ae9b48a38a4dc0"} Sep 10 18:40:54.069733 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.069547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" event={"ID":"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8","Type":"ContainerStarted","Data":"4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d"} Sep 10 18:40:54.575573 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.575532 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b"] Sep 10 18:40:54.579193 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.579168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.582235 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.582212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 18:40:54.582461 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.582447 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 18:40:54.582613 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.582596 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 18:40:54.582857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.582844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 18:40:54.585215 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.585189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2hqf5\"" Sep 10 18:40:54.617745 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.617659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b"] Sep 10 18:40:54.658833 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.658789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fh5m\" (UniqueName: \"kubernetes.io/projected/06278012-6830-4bff-b3dc-d5e1db3bc575-kube-api-access-8fh5m\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.659023 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.658842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-tmp\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.659023 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.658922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.659023 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.658963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-manifests\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.659023 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.658983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760076 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760076 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-manifests\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760497 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fh5m\" (UniqueName: \"kubernetes.io/projected/06278012-6830-4bff-b3dc-d5e1db3bc575-kube-api-access-8fh5m\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760497 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-manifests\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.760497 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.760499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-tmp\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.764087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.762945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06278012-6830-4bff-b3dc-d5e1db3bc575-tmp\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.764087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.763010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.764087 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.763135 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06278012-6830-4bff-b3dc-d5e1db3bc575-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.770654 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.770630 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fh5m\" (UniqueName: \"kubernetes.io/projected/06278012-6830-4bff-b3dc-d5e1db3bc575-kube-api-access-8fh5m\") pod \"opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b\" (UID: \"06278012-6830-4bff-b3dc-d5e1db3bc575\") " pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:54.889843 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:54.889811 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:40:55.075966 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:55.075927 2579 generic.go:356] "Generic (PLEG): container finished" podID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerID="7fe585368364d751f364e4a9705933aeda23355b082ea7b5f9b8dbb49f58e99b" exitCode=0 Sep 10 18:40:55.076165 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:55.075997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" event={"ID":"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8","Type":"ContainerDied","Data":"7fe585368364d751f364e4a9705933aeda23355b082ea7b5f9b8dbb49f58e99b"} Sep 10 18:40:55.173425 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:55.173397 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b"] Sep 10 18:40:55.176049 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:40:55.176020 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06278012_6830_4bff_b3dc_d5e1db3bc575.slice/crio-66d5b9384872f2f0fd19a8168a2cbb2a60ef30b6c128599fc0d4f909d37e0aed WatchSource:0}: Error finding container 66d5b9384872f2f0fd19a8168a2cbb2a60ef30b6c128599fc0d4f909d37e0aed: Status 404 returned error can't find the container with id 66d5b9384872f2f0fd19a8168a2cbb2a60ef30b6c128599fc0d4f909d37e0aed Sep 10 18:40:56.088038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:56.087985 2579 generic.go:356] "Generic (PLEG): container finished" podID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerID="affd040fb8b67fdb5b610a85455109667a7fe60a4264848b22596b7bc6e9c40b" exitCode=0 Sep 10 18:40:56.088510 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:56.088049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" event={"ID":"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8","Type":"ContainerDied","Data":"affd040fb8b67fdb5b610a85455109667a7fe60a4264848b22596b7bc6e9c40b"} Sep 10 18:40:56.090188 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:56.090161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" event={"ID":"06278012-6830-4bff-b3dc-d5e1db3bc575","Type":"ContainerStarted","Data":"66d5b9384872f2f0fd19a8168a2cbb2a60ef30b6c128599fc0d4f909d37e0aed"} Sep 10 18:40:58.161213 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.161187 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:58.191041 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.191008 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util\") pod \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " Sep 10 18:40:58.191251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.191141 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt6vp\" (UniqueName: \"kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp\") pod \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " Sep 10 18:40:58.191600 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.191577 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle\") pod \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\" (UID: \"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8\") " Sep 10 18:40:58.192609 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.192566 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle" (OuterVolumeSpecName: "bundle") pod "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" (UID: "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:58.193642 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.193614 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp" (OuterVolumeSpecName: "kube-api-access-pt6vp") pod "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" (UID: "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8"). InnerVolumeSpecName "kube-api-access-pt6vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:40:58.197028 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.197004 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util" (OuterVolumeSpecName: "util") pod "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" (UID: "d5b337e8-4d59-46c0-85d5-a53dfd05b7e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:40:58.292607 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.292573 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt6vp\" (UniqueName: \"kubernetes.io/projected/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-kube-api-access-pt6vp\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:58.292607 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.292600 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:58.292607 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:58.292610 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5b337e8-4d59-46c0-85d5-a53dfd05b7e8-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:40:59.112874 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:59.112848 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" Sep 10 18:40:59.113090 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:59.112886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0v62d6" event={"ID":"d5b337e8-4d59-46c0-85d5-a53dfd05b7e8","Type":"ContainerDied","Data":"4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d"} Sep 10 18:40:59.113090 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:59.112959 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4df70e1fd45c828dd4eccb6e4a7a1fa8cde07323e5ef2c5530981459698a451d" Sep 10 18:40:59.114660 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:40:59.114618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" event={"ID":"06278012-6830-4bff-b3dc-d5e1db3bc575","Type":"ContainerStarted","Data":"edb5eadadfaf242c88e34ed396b351fe9cd5c3ab2535a9cb202cc039f7e3e4cc"} Sep 10 18:41:00.121115 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:00.121073 2579 generic.go:356] "Generic (PLEG): container finished" podID="06278012-6830-4bff-b3dc-d5e1db3bc575" containerID="edb5eadadfaf242c88e34ed396b351fe9cd5c3ab2535a9cb202cc039f7e3e4cc" exitCode=0 Sep 10 18:41:00.121499 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:00.121149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" event={"ID":"06278012-6830-4bff-b3dc-d5e1db3bc575","Type":"ContainerDied","Data":"edb5eadadfaf242c88e34ed396b351fe9cd5c3ab2535a9cb202cc039f7e3e4cc"} Sep 10 18:41:01.128204 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:01.128171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" event={"ID":"06278012-6830-4bff-b3dc-d5e1db3bc575","Type":"ContainerStarted","Data":"33d92b44139e307db59234d1b15719543e3aa0c99c60528e07671d54cb161792"} Sep 10 18:41:01.128780 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:01.128292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:41:01.152458 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:01.152407 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" podStartSLOduration=2.67465447 podStartE2EDuration="7.152392061s" totalImagesPullingTime="3.376943202s" totalInitContainerRuntime="1.100794389s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:40:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:41:01.150488946 +0000 UTC m=+584.983804520" watchObservedRunningTime="2026-09-10 18:41:01.152392061 +0000 UTC m=+584.985707635" Sep 10 18:41:02.062614 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:02.062586 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-ddb978bf8-vt7q9" Sep 10 18:41:07.287792 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.287758 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5d644fbc-dcz5r"] Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288103 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="extract" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288117 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="extract" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288135 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="pull" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288141 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="pull" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288151 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="util" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288156 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="util" Sep 10 18:41:07.288221 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.288214 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b337e8-4d59-46c0-85d5-a53dfd05b7e8" containerName="extract" Sep 10 18:41:07.296479 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.296453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.304328 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.304299 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5d644fbc-dcz5r"] Sep 10 18:41:07.376837 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.376791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-service-ca\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.376837 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.376838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-oauth-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.377052 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.376918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.377052 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.377013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-oauth-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.377052 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.377037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfck2\" (UniqueName: \"kubernetes.io/projected/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-kube-api-access-tfck2\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.377181 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.377134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-trusted-ca-bundle\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.377181 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.377157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478386 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-trusted-ca-bundle\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478386 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478549 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-service-ca\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478628 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-oauth-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478693 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478748 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-oauth-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.478800 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.478750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfck2\" (UniqueName: \"kubernetes.io/projected/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-kube-api-access-tfck2\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.479259 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.479232 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-service-ca\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.479365 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.479311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-oauth-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.479365 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.479346 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.479492 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.479474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-trusted-ca-bundle\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.481369 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.481349 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-serving-cert\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.481419 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.481378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-console-oauth-config\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.486463 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.486440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfck2\" (UniqueName: \"kubernetes.io/projected/a20ae8bc-fa25-49ee-b34b-7475c39c0a1c-kube-api-access-tfck2\") pod \"console-6d5d644fbc-dcz5r\" (UID: \"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c\") " pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.606674 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.606635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:07.879387 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:07.879360 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5d644fbc-dcz5r"] Sep 10 18:41:07.881414 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:41:07.881384 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20ae8bc_fa25_49ee_b34b_7475c39c0a1c.slice/crio-bfee85c8ba8f55dec5446ca79d401606e7f41299c39566637c947541e9b9f52d WatchSource:0}: Error finding container bfee85c8ba8f55dec5446ca79d401606e7f41299c39566637c947541e9b9f52d: Status 404 returned error can't find the container with id bfee85c8ba8f55dec5446ca79d401606e7f41299c39566637c947541e9b9f52d Sep 10 18:41:08.163697 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:08.163609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d644fbc-dcz5r" event={"ID":"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c","Type":"ContainerStarted","Data":"c3464ccc46c2b31990b45889fc6e8090a4bd5a06b13dc7379b822199da5399f0"} Sep 10 18:41:08.163697 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:08.163661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5d644fbc-dcz5r" event={"ID":"a20ae8bc-fa25-49ee-b34b-7475c39c0a1c","Type":"ContainerStarted","Data":"bfee85c8ba8f55dec5446ca79d401606e7f41299c39566637c947541e9b9f52d"} Sep 10 18:41:08.179856 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:08.179789 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5d644fbc-dcz5r" podStartSLOduration=1.179765933 podStartE2EDuration="1.179765933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:41:08.179277557 +0000 UTC m=+592.012593132" watchObservedRunningTime="2026-09-10 18:41:08.179765933 +0000 UTC m=+592.013081510" Sep 10 18:41:12.135225 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:12.135196 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b" Sep 10 18:41:16.648614 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:16.648588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:41:16.648614 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:16.648600 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:41:17.607534 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:17.607494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:17.607706 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:17.607564 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:17.612501 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:17.612480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:18.215119 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:18.215095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5d644fbc-dcz5r" Sep 10 18:41:18.262070 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:18.262017 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:41:20.339224 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.339191 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd"] Sep 10 18:41:20.342742 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.342722 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.345407 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.345364 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 18:41:20.345546 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.345490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mqql8\"" Sep 10 18:41:20.355170 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.355146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd"] Sep 10 18:41:20.487641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzvw\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-kube-api-access-wpzvw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.487841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.488089 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.488089 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.487921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589136 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589292 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzvw\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-kube-api-access-wpzvw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589559 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589669 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.589912 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.589896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.591767 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.591744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.591857 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.591841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.596463 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.596445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzvw\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-kube-api-access-wpzvw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.596562 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.596542 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd\" (UID: \"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.653701 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.653679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:20.927930 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:20.927902 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd"] Sep 10 18:41:20.929301 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:41:20.929278 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d6f650_320c_4ba3_8a33_c2d07e5dc1cf.slice/crio-6e000d3a7ea549ef0a2aa13b952db6fa6cfacca7b677b0732a18f7db048f68ec WatchSource:0}: Error finding container 6e000d3a7ea549ef0a2aa13b952db6fa6cfacca7b677b0732a18f7db048f68ec: Status 404 returned error can't find the container with id 6e000d3a7ea549ef0a2aa13b952db6fa6cfacca7b677b0732a18f7db048f68ec Sep 10 18:41:21.229185 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:21.229105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" event={"ID":"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf","Type":"ContainerStarted","Data":"6e000d3a7ea549ef0a2aa13b952db6fa6cfacca7b677b0732a18f7db048f68ec"} Sep 10 18:41:23.886708 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:23.886673 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 18:41:23.886987 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:23.886743 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 18:41:23.886987 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:23.886772 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 18:41:24.248681 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:24.248590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" event={"ID":"f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf","Type":"ContainerStarted","Data":"8f136398a6b372f716cca99ae34114fadd17afee0d571481559acda9d4b01c9d"} Sep 10 18:41:24.267875 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:24.267827 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" podStartSLOduration=1.312715868 podStartE2EDuration="4.267812797s" totalImagesPullingTime="2.955096929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:41:24.265889876 +0000 UTC m=+608.099205452" watchObservedRunningTime="2026-09-10 18:41:24.267812797 +0000 UTC m=+608.101128370" Sep 10 18:41:24.654597 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:24.654566 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:24.659200 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:24.659178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:25.253728 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:25.253697 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:25.254639 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:25.254619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd" Sep 10 18:41:31.651247 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.651214 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh"] Sep 10 18:41:31.660274 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.660248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.664149 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.664121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 18:41:31.664286 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.664247 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 18:41:31.664401 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.664382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 18:41:31.664590 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.664573 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rmns6\"" Sep 10 18:41:31.671111 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.671087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh"] Sep 10 18:41:31.778897 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.778875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779013 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.778907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779013 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.778927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkfl\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-kube-api-access-tkkfl\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.779030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.779086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.779104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.779120 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.779118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880125 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkfl\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-kube-api-access-tkkfl\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880253 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.880531 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.880343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.881044 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.881023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.882503 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.882482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.882628 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.882605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.882771 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.882753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.882926 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.882909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.887786 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.887765 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkfl\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-kube-api-access-tkkfl\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.887868 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.887773 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aec46b3a-90e5-4dcd-aeb5-24995e1984aa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6rvxh\" (UID: \"aec46b3a-90e5-4dcd-aeb5-24995e1984aa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:31.973541 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:31.973483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:32.258035 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:32.257937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh"] Sep 10 18:41:32.260998 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:41:32.260964 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec46b3a_90e5_4dcd_aeb5_24995e1984aa.slice/crio-23c000cca829a79098a2655786bde7829bafba109a5ee159fb345aa38336225f WatchSource:0}: Error finding container 23c000cca829a79098a2655786bde7829bafba109a5ee159fb345aa38336225f: Status 404 returned error can't find the container with id 23c000cca829a79098a2655786bde7829bafba109a5ee159fb345aa38336225f Sep 10 18:41:32.287763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:32.287736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" event={"ID":"aec46b3a-90e5-4dcd-aeb5-24995e1984aa","Type":"ContainerStarted","Data":"23c000cca829a79098a2655786bde7829bafba109a5ee159fb345aa38336225f"} Sep 10 18:41:34.636784 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:34.636746 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 18:41:34.637166 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:34.636828 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 10 18:41:35.327229 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:35.327192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" event={"ID":"aec46b3a-90e5-4dcd-aeb5-24995e1984aa","Type":"ContainerStarted","Data":"34e9e97567d04defac7c718cc19f82cce4f34e1c6577efa7b228d33d7d7a04b8"} Sep 10 18:41:35.327416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:35.327344 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:35.328973 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:35.328941 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-6rvxh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 18:41:35.329079 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:35.329013 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" podUID="aec46b3a-90e5-4dcd-aeb5-24995e1984aa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 18:41:35.350302 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:35.350264 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" podStartSLOduration=1.97715521 podStartE2EDuration="4.350250621s" totalImagesPullingTime="2.373095411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:41:35.347445051 +0000 UTC m=+619.180760629" watchObservedRunningTime="2026-09-10 18:41:35.350250621 +0000 UTC m=+619.183566196" Sep 10 18:41:36.334009 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:36.333972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6rvxh" Sep 10 18:41:43.287018 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.286913 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-786c5448fb-542kg" podUID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" containerName="console" containerID="cri-o://f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168" gracePeriod=15 Sep 10 18:41:43.530663 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.530643 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:41:43.581539 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581515 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581667 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581564 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hggt\" (UniqueName: \"kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581731 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581681 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581731 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581726 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581836 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581760 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581836 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581811 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.581946 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.581838 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert\") pod \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\" (UID: \"6a245f81-0547-41cf-bdd8-eb33d45b0b51\") " Sep 10 18:41:43.582198 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.582158 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:41:43.582198 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.582173 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:41:43.582471 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.582372 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:41:43.582535 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.582509 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config" (OuterVolumeSpecName: "console-config") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 18:41:43.583688 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.583663 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt" (OuterVolumeSpecName: "kube-api-access-2hggt") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "kube-api-access-2hggt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:41:43.583767 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.583687 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:41:43.583767 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.583701 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a245f81-0547-41cf-bdd8-eb33d45b0b51" (UID: "6a245f81-0547-41cf-bdd8-eb33d45b0b51"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:41:43.682589 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682569 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-trusted-ca-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682589 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682588 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682715 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682598 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682715 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682608 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a245f81-0547-41cf-bdd8-eb33d45b0b51-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682715 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682616 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682715 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682624 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hggt\" (UniqueName: \"kubernetes.io/projected/6a245f81-0547-41cf-bdd8-eb33d45b0b51-kube-api-access-2hggt\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:43.682715 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:43.682632 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a245f81-0547-41cf-bdd8-eb33d45b0b51-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:41:44.373814 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.373776 2579 generic.go:356] "Generic (PLEG): container finished" podID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" containerID="f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168" exitCode=0 Sep 10 18:41:44.374341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.373832 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786c5448fb-542kg" Sep 10 18:41:44.374341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.373868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c5448fb-542kg" event={"ID":"6a245f81-0547-41cf-bdd8-eb33d45b0b51","Type":"ContainerDied","Data":"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168"} Sep 10 18:41:44.374341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.373946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786c5448fb-542kg" event={"ID":"6a245f81-0547-41cf-bdd8-eb33d45b0b51","Type":"ContainerDied","Data":"a9aa970305f208b2e0b654ce88f82d5911bf4040af7dedda369ac182ab55e2f5"} Sep 10 18:41:44.374341 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.373982 2579 scope.go:117] "RemoveContainer" containerID="f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168" Sep 10 18:41:44.384502 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.384485 2579 scope.go:117] "RemoveContainer" containerID="f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168" Sep 10 18:41:44.384815 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:41:44.384795 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168\": container with ID starting with f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168 not found: ID does not exist" containerID="f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168" Sep 10 18:41:44.384859 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.384825 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168"} err="failed to get container status \"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168\": rpc error: code = NotFound desc = could not find container \"f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168\": container with ID starting with f93789ba961175189c6bbf5421299b0c55026d51d5e66c9ede4a3c3776458168 not found: ID does not exist" Sep 10 18:41:44.395991 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.395966 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:41:44.398759 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.398728 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786c5448fb-542kg"] Sep 10 18:41:44.695952 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:41:44.695874 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" path="/var/lib/kubelet/pods/6a245f81-0547-41cf-bdd8-eb33d45b0b51/volumes" Sep 10 18:42:29.054983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.054950 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl"] Sep 10 18:42:29.055436 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.055326 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" containerName="console" Sep 10 18:42:29.055436 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.055337 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" containerName="console" Sep 10 18:42:29.055436 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.055426 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a245f81-0547-41cf-bdd8-eb33d45b0b51" containerName="console" Sep 10 18:42:29.059983 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.059962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.062551 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.062528 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lhgtj\"" Sep 10 18:42:29.062551 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.062542 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 18:42:29.063872 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.063852 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 18:42:29.066907 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.066883 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl"] Sep 10 18:42:29.147501 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.147469 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47"] Sep 10 18:42:29.151276 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.151256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.158464 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.158595 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.158595 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.158717 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkwz\" (UniqueName: \"kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.158717 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zhk\" (UniqueName: \"kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.158717 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.158693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.159409 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.159381 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47"] Sep 10 18:42:29.246069 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.246017 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk"] Sep 10 18:42:29.249938 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.249915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.257208 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.257169 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk"] Sep 10 18:42:29.259380 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqjkl\" (UniqueName: \"kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.259516 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkwz\" (UniqueName: \"kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.259516 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zhk\" (UniqueName: \"kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.259644 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.259644 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.259644 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.259644 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.259820 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.259820 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.259711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.260212 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.260191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.260299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.260276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.260299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.260287 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.260371 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.260325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.269687 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.269660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zhk\" (UniqueName: \"kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.269909 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.269887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkwz\" (UniqueName: \"kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.348971 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.348951 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc"] Sep 10 18:42:29.352746 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.352733 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.360324 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.360444 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcmv\" (UniqueName: \"kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.360444 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.360561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.360561 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.360669 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqjkl\" (UniqueName: \"kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.360722 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc"] Sep 10 18:42:29.360810 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.360984 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.360967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.368690 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.368575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqjkl\" (UniqueName: \"kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.370892 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.370873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:29.461287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.461257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.461413 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.461322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.461413 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.461341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcmv\" (UniqueName: \"kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.461664 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.461645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.461737 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.461715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.463146 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.463128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:29.469027 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.469008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcmv\" (UniqueName: \"kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.561668 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.561639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:29.640869 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.640835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl"] Sep 10 18:42:29.641412 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:42:29.641384 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb932a035_4e5f_4b07_9bb0_70d23b6d01d4.slice/crio-612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d WatchSource:0}: Error finding container 612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d: Status 404 returned error can't find the container with id 612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d Sep 10 18:42:29.662523 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.662496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:29.735103 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.735039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47"] Sep 10 18:42:29.735770 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:42:29.735744 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530398f5_fc04_41c4_9cec_d43a35c99588.slice/crio-567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8 WatchSource:0}: Error finding container 567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8: Status 404 returned error can't find the container with id 567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8 Sep 10 18:42:29.848661 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.848632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk"] Sep 10 18:42:29.850108 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:42:29.850082 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4a9d26_9d82_43af_97da_16c1fa00bd96.slice/crio-b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290 WatchSource:0}: Error finding container b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290: Status 404 returned error can't find the container with id b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290 Sep 10 18:42:29.940366 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:29.940345 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc"] Sep 10 18:42:29.943523 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:42:29.943497 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0694ca08_94f0_481a_bfff_7759c1bc81fd.slice/crio-b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f WatchSource:0}: Error finding container b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f: Status 404 returned error can't find the container with id b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f Sep 10 18:42:30.599277 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.599242 2579 generic.go:356] "Generic (PLEG): container finished" podID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerID="e7eb57ee4e0c8ef7704096a85b7133f0ffc3448cabd7bf7754f865fd2375691d" exitCode=0 Sep 10 18:42:30.599701 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.599327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" event={"ID":"2b4a9d26-9d82-43af-97da-16c1fa00bd96","Type":"ContainerDied","Data":"e7eb57ee4e0c8ef7704096a85b7133f0ffc3448cabd7bf7754f865fd2375691d"} Sep 10 18:42:30.599701 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.599376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" event={"ID":"2b4a9d26-9d82-43af-97da-16c1fa00bd96","Type":"ContainerStarted","Data":"b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290"} Sep 10 18:42:30.600514 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.600387 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 18:42:30.600988 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.600918 2579 generic.go:356] "Generic (PLEG): container finished" podID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerID="effaff9238759083d076b25d71eb4e6f89ace6c79cd330950778816f651937d1" exitCode=0 Sep 10 18:42:30.601083 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.600997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" event={"ID":"0694ca08-94f0-481a-bfff-7759c1bc81fd","Type":"ContainerDied","Data":"effaff9238759083d076b25d71eb4e6f89ace6c79cd330950778816f651937d1"} Sep 10 18:42:30.601083 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.601037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" event={"ID":"0694ca08-94f0-481a-bfff-7759c1bc81fd","Type":"ContainerStarted","Data":"b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f"} Sep 10 18:42:30.602567 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.602551 2579 generic.go:356] "Generic (PLEG): container finished" podID="530398f5-fc04-41c4-9cec-d43a35c99588" containerID="d1e6d5949b6861c86691c5ddda42eb5a68fe2bfa95fbf8b33f8eaf5c5086685a" exitCode=0 Sep 10 18:42:30.602669 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.602645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" event={"ID":"530398f5-fc04-41c4-9cec-d43a35c99588","Type":"ContainerDied","Data":"d1e6d5949b6861c86691c5ddda42eb5a68fe2bfa95fbf8b33f8eaf5c5086685a"} Sep 10 18:42:30.602743 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.602697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" event={"ID":"530398f5-fc04-41c4-9cec-d43a35c99588","Type":"ContainerStarted","Data":"567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8"} Sep 10 18:42:30.604383 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.604363 2579 generic.go:356] "Generic (PLEG): container finished" podID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerID="14a83af076401c3ca7ef32da54b5de21e76a0896928685c3ed1c6c3138f8942f" exitCode=0 Sep 10 18:42:30.604470 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.604450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" event={"ID":"b932a035-4e5f-4b07-9bb0-70d23b6d01d4","Type":"ContainerDied","Data":"14a83af076401c3ca7ef32da54b5de21e76a0896928685c3ed1c6c3138f8942f"} Sep 10 18:42:30.604512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:30.604496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" event={"ID":"b932a035-4e5f-4b07-9bb0-70d23b6d01d4","Type":"ContainerStarted","Data":"612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d"} Sep 10 18:42:31.611038 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:31.611007 2579 generic.go:356] "Generic (PLEG): container finished" podID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerID="c2e356c6be6d6b46d144ead5918198b998c588a8b741052e997826adff9826d3" exitCode=0 Sep 10 18:42:31.611444 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:31.611096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" event={"ID":"0694ca08-94f0-481a-bfff-7759c1bc81fd","Type":"ContainerDied","Data":"c2e356c6be6d6b46d144ead5918198b998c588a8b741052e997826adff9826d3"} Sep 10 18:42:31.612931 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:31.612914 2579 generic.go:356] "Generic (PLEG): container finished" podID="530398f5-fc04-41c4-9cec-d43a35c99588" containerID="fb826aeb3369c3db17476bbdc7b82537ae965bb5c927d039a77a68829bfc9b74" exitCode=0 Sep 10 18:42:31.613036 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:31.612998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" event={"ID":"530398f5-fc04-41c4-9cec-d43a35c99588","Type":"ContainerDied","Data":"fb826aeb3369c3db17476bbdc7b82537ae965bb5c927d039a77a68829bfc9b74"} Sep 10 18:42:32.621779 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.621736 2579 generic.go:356] "Generic (PLEG): container finished" podID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerID="c51e96b3819f829c49bbe04107ca4e583fbf22b98571788d214554b88d91e7e1" exitCode=0 Sep 10 18:42:32.622234 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.621826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" event={"ID":"2b4a9d26-9d82-43af-97da-16c1fa00bd96","Type":"ContainerDied","Data":"c51e96b3819f829c49bbe04107ca4e583fbf22b98571788d214554b88d91e7e1"} Sep 10 18:42:32.624899 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.624869 2579 generic.go:356] "Generic (PLEG): container finished" podID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerID="da417077221688b32143108ad47e81a1ea8d558d4d2e94317a378b64adff678c" exitCode=0 Sep 10 18:42:32.625002 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.624904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" event={"ID":"0694ca08-94f0-481a-bfff-7759c1bc81fd","Type":"ContainerDied","Data":"da417077221688b32143108ad47e81a1ea8d558d4d2e94317a378b64adff678c"} Sep 10 18:42:32.627594 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.627539 2579 generic.go:356] "Generic (PLEG): container finished" podID="530398f5-fc04-41c4-9cec-d43a35c99588" containerID="ed96af42f549592a67136c1283f78ffa01256b48392850af2cc351ff5c4eb8fa" exitCode=0 Sep 10 18:42:32.627677 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.627640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" event={"ID":"530398f5-fc04-41c4-9cec-d43a35c99588","Type":"ContainerDied","Data":"ed96af42f549592a67136c1283f78ffa01256b48392850af2cc351ff5c4eb8fa"} Sep 10 18:42:32.629914 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.629887 2579 generic.go:356] "Generic (PLEG): container finished" podID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerID="68dfa9dc36b5c32a1f95d72bd1e3773550e6997d1e3a9e71ae2a642b6c612852" exitCode=0 Sep 10 18:42:32.630039 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:32.629988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" event={"ID":"b932a035-4e5f-4b07-9bb0-70d23b6d01d4","Type":"ContainerDied","Data":"68dfa9dc36b5c32a1f95d72bd1e3773550e6997d1e3a9e71ae2a642b6c612852"} Sep 10 18:42:33.637194 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.637159 2579 generic.go:356] "Generic (PLEG): container finished" podID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerID="8b19f61d9f6c5aeecfae19f4a2153879e4c8e4bb95745727e8b2b29c15aca6fe" exitCode=0 Sep 10 18:42:33.637630 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.637246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" event={"ID":"b932a035-4e5f-4b07-9bb0-70d23b6d01d4","Type":"ContainerDied","Data":"8b19f61d9f6c5aeecfae19f4a2153879e4c8e4bb95745727e8b2b29c15aca6fe"} Sep 10 18:42:33.639360 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.639338 2579 generic.go:356] "Generic (PLEG): container finished" podID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerID="36c3487c3d509417052c903e6c044df70f02193dc9e5af4a67a1c02859abb231" exitCode=0 Sep 10 18:42:33.639457 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.639392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" event={"ID":"2b4a9d26-9d82-43af-97da-16c1fa00bd96","Type":"ContainerDied","Data":"36c3487c3d509417052c903e6c044df70f02193dc9e5af4a67a1c02859abb231"} Sep 10 18:42:33.797480 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.797451 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:33.800217 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.800199 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:33.898399 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898336 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle\") pod \"0694ca08-94f0-481a-bfff-7759c1bc81fd\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " Sep 10 18:42:33.898399 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898367 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfcmv\" (UniqueName: \"kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv\") pod \"0694ca08-94f0-481a-bfff-7759c1bc81fd\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " Sep 10 18:42:33.898399 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898391 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util\") pod \"530398f5-fc04-41c4-9cec-d43a35c99588\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " Sep 10 18:42:33.898643 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898436 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util\") pod \"0694ca08-94f0-481a-bfff-7759c1bc81fd\" (UID: \"0694ca08-94f0-481a-bfff-7759c1bc81fd\") " Sep 10 18:42:33.898643 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898524 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle\") pod \"530398f5-fc04-41c4-9cec-d43a35c99588\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " Sep 10 18:42:33.898643 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898585 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbkwz\" (UniqueName: \"kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz\") pod \"530398f5-fc04-41c4-9cec-d43a35c99588\" (UID: \"530398f5-fc04-41c4-9cec-d43a35c99588\") " Sep 10 18:42:33.899019 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.898978 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle" (OuterVolumeSpecName: "bundle") pod "0694ca08-94f0-481a-bfff-7759c1bc81fd" (UID: "0694ca08-94f0-481a-bfff-7759c1bc81fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:33.899125 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.899032 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle" (OuterVolumeSpecName: "bundle") pod "530398f5-fc04-41c4-9cec-d43a35c99588" (UID: "530398f5-fc04-41c4-9cec-d43a35c99588"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:33.900532 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.900511 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv" (OuterVolumeSpecName: "kube-api-access-vfcmv") pod "0694ca08-94f0-481a-bfff-7759c1bc81fd" (UID: "0694ca08-94f0-481a-bfff-7759c1bc81fd"). InnerVolumeSpecName "kube-api-access-vfcmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:42:33.901001 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.900980 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz" (OuterVolumeSpecName: "kube-api-access-jbkwz") pod "530398f5-fc04-41c4-9cec-d43a35c99588" (UID: "530398f5-fc04-41c4-9cec-d43a35c99588"). InnerVolumeSpecName "kube-api-access-jbkwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:42:33.904610 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.904578 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util" (OuterVolumeSpecName: "util") pod "530398f5-fc04-41c4-9cec-d43a35c99588" (UID: "530398f5-fc04-41c4-9cec-d43a35c99588"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:33.905608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.905586 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util" (OuterVolumeSpecName: "util") pod "0694ca08-94f0-481a-bfff-7759c1bc81fd" (UID: "0694ca08-94f0-481a-bfff-7759c1bc81fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:33.999512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999487 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:33.999512 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999510 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbkwz\" (UniqueName: \"kubernetes.io/projected/530398f5-fc04-41c4-9cec-d43a35c99588-kube-api-access-jbkwz\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:33.999633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999520 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:33.999633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999528 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfcmv\" (UniqueName: \"kubernetes.io/projected/0694ca08-94f0-481a-bfff-7759c1bc81fd-kube-api-access-vfcmv\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:33.999633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999536 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530398f5-fc04-41c4-9cec-d43a35c99588-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:33.999633 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:33.999544 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0694ca08-94f0-481a-bfff-7759c1bc81fd-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:34.647716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.647678 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" Sep 10 18:42:34.648160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.647672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8f7hc" event={"ID":"0694ca08-94f0-481a-bfff-7759c1bc81fd","Type":"ContainerDied","Data":"b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f"} Sep 10 18:42:34.648160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.647820 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2aa7525940f74389510748006f8042ba06d797e99782df063fa7a7b032a754f" Sep 10 18:42:34.650077 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.650039 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" Sep 10 18:42:34.650203 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.650082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wmk47" event={"ID":"530398f5-fc04-41c4-9cec-d43a35c99588","Type":"ContainerDied","Data":"567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8"} Sep 10 18:42:34.650203 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.650127 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="567d2c7b7ac4c66428e4a1e71cc2f3be939d6b6d07f2f3dc203a87712a9baac8" Sep 10 18:42:34.801887 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.801864 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:42:34.803835 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.803819 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:34.906889 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906815 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle\") pod \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " Sep 10 18:42:34.906889 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906864 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle\") pod \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " Sep 10 18:42:34.906889 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906889 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util\") pod \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " Sep 10 18:42:34.907251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906939 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util\") pod \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " Sep 10 18:42:34.907251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906965 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24zhk\" (UniqueName: \"kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk\") pod \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\" (UID: \"b932a035-4e5f-4b07-9bb0-70d23b6d01d4\") " Sep 10 18:42:34.907251 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.906990 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqjkl\" (UniqueName: \"kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl\") pod \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\" (UID: \"2b4a9d26-9d82-43af-97da-16c1fa00bd96\") " Sep 10 18:42:34.907408 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.907374 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle" (OuterVolumeSpecName: "bundle") pod "2b4a9d26-9d82-43af-97da-16c1fa00bd96" (UID: "2b4a9d26-9d82-43af-97da-16c1fa00bd96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:34.907626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.907607 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle" (OuterVolumeSpecName: "bundle") pod "b932a035-4e5f-4b07-9bb0-70d23b6d01d4" (UID: "b932a035-4e5f-4b07-9bb0-70d23b6d01d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:34.909169 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.909143 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl" (OuterVolumeSpecName: "kube-api-access-nqjkl") pod "2b4a9d26-9d82-43af-97da-16c1fa00bd96" (UID: "2b4a9d26-9d82-43af-97da-16c1fa00bd96"). InnerVolumeSpecName "kube-api-access-nqjkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:42:34.909279 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.909251 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk" (OuterVolumeSpecName: "kube-api-access-24zhk") pod "b932a035-4e5f-4b07-9bb0-70d23b6d01d4" (UID: "b932a035-4e5f-4b07-9bb0-70d23b6d01d4"). InnerVolumeSpecName "kube-api-access-24zhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:42:34.912474 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.912451 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util" (OuterVolumeSpecName: "util") pod "2b4a9d26-9d82-43af-97da-16c1fa00bd96" (UID: "2b4a9d26-9d82-43af-97da-16c1fa00bd96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:34.965568 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:34.965539 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util" (OuterVolumeSpecName: "util") pod "b932a035-4e5f-4b07-9bb0-70d23b6d01d4" (UID: "b932a035-4e5f-4b07-9bb0-70d23b6d01d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 18:42:35.007920 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007898 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqjkl\" (UniqueName: \"kubernetes.io/projected/2b4a9d26-9d82-43af-97da-16c1fa00bd96-kube-api-access-nqjkl\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.007920 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007919 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.008030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007931 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.008030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007938 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4a9d26-9d82-43af-97da-16c1fa00bd96-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.008030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007946 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-util\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.008030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.007955 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24zhk\" (UniqueName: \"kubernetes.io/projected/b932a035-4e5f-4b07-9bb0-70d23b6d01d4-kube-api-access-24zhk\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:42:35.658161 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.658132 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" Sep 10 18:42:35.658537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.658174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adwvhl" event={"ID":"b932a035-4e5f-4b07-9bb0-70d23b6d01d4","Type":"ContainerDied","Data":"612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d"} Sep 10 18:42:35.658537 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.658228 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="612471cfd7bbdca6aec94256e673880ae15d4f9ec6da816aad738fbdf1c7019d" Sep 10 18:42:35.660235 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.660193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" event={"ID":"2b4a9d26-9d82-43af-97da-16c1fa00bd96","Type":"ContainerDied","Data":"b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290"} Sep 10 18:42:35.660235 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.660238 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b53712cce359e204d654c8a2fd3061c839d0a3a1a9ed548b005a1f3611f05290" Sep 10 18:42:35.660389 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:42:35.660208 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64sbmk" Sep 10 18:44:13.787435 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787402 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787870 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="util" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787889 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="util" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787906 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="util" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787914 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="util" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787922 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="extract" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787931 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="extract" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787943 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="extract" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787952 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="extract" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787968 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="pull" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787976 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="pull" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.787993 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="pull" Sep 10 18:44:13.788003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788000 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="pull" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788013 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="pull" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788021 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="pull" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788029 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788037 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788069 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788079 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788092 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="pull" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788099 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="pull" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788111 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="util" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788119 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="util" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788129 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="util" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788137 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="util" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788222 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4a9d26-9d82-43af-97da-16c1fa00bd96" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788234 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="530398f5-fc04-41c4-9cec-d43a35c99588" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788243 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b932a035-4e5f-4b07-9bb0-70d23b6d01d4" containerName="extract" Sep 10 18:44:13.788641 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.788254 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0694ca08-94f0-481a-bfff-7759c1bc81fd" containerName="extract" Sep 10 18:44:13.791472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.791450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:13.794549 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.794529 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 18:44:13.794657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.794551 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-crn59\"" Sep 10 18:44:13.794657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.794575 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 18:44:13.794657 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.794620 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 18:44:13.803182 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.803158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:13.919317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.919269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:13.919479 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.919344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bh9\" (UniqueName: \"kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:13.919479 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.919383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:13.960322 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.960297 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b4bbfb4b4-jjgs6"] Sep 10 18:44:13.963758 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.963740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:13.974774 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:13.974741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4bbfb4b4-jjgs6"] Sep 10 18:44:14.020368 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.020341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.020479 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.020391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bh9\" (UniqueName: \"kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.020479 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.020430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.020589 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:44:14.020544 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 18:44:14.020637 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:44:14.020608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert podName:26a752a3-9e6c-4dfa-a91b-b23da45c125b nodeName:}" failed. No retries permitted until 2026-09-10 18:44:14.52058826 +0000 UTC m=+778.353903831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert") pod "maas-controller-699cbb7594-7hmnq" (UID: "26a752a3-9e6c-4dfa-a91b-b23da45c125b") : secret "maas-controller-webhook-cert" not found Sep 10 18:44:14.022671 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.022649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.028923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.028904 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bh9\" (UniqueName: \"kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.121577 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.121552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.121680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.121593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vdr5\" (UniqueName: \"kubernetes.io/projected/b76cb7cc-7930-479f-93b9-194ac68ce779-kube-api-access-8vdr5\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.121750 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.121696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-metrics-certs\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.223188 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.223156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.223188 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.223190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vdr5\" (UniqueName: \"kubernetes.io/projected/b76cb7cc-7930-479f-93b9-194ac68ce779-kube-api-access-8vdr5\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.223431 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.223225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-metrics-certs\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.223431 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:44:14.223329 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 18:44:14.223431 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:44:14.223414 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert podName:b76cb7cc-7930-479f-93b9-194ac68ce779 nodeName:}" failed. No retries permitted until 2026-09-10 18:44:14.723392604 +0000 UTC m=+778.556708159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert") pod "maas-controller-7b4bbfb4b4-jjgs6" (UID: "b76cb7cc-7930-479f-93b9-194ac68ce779") : secret "maas-controller-webhook-cert" not found Sep 10 18:44:14.225822 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.225799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-metrics-certs\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.231399 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.231375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vdr5\" (UniqueName: \"kubernetes.io/projected/b76cb7cc-7930-479f-93b9-194ac68ce779-kube-api-access-8vdr5\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.526243 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.526176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.528398 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.528374 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") pod \"maas-controller-699cbb7594-7hmnq\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.703484 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.703456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:14.727658 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.727632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.729979 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.729954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b76cb7cc-7930-479f-93b9-194ac68ce779-webhook-cert\") pod \"maas-controller-7b4bbfb4b4-jjgs6\" (UID: \"b76cb7cc-7930-479f-93b9-194ac68ce779\") " pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.874649 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.874618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:14.971845 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:14.971806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:14.972769 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:44:14.972740 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a752a3_9e6c_4dfa_a91b_b23da45c125b.slice/crio-06cfd8623957c90fdf609fd22ef6d6a64f8e2217fd73b9051cac83900a6723a1 WatchSource:0}: Error finding container 06cfd8623957c90fdf609fd22ef6d6a64f8e2217fd73b9051cac83900a6723a1: Status 404 returned error can't find the container with id 06cfd8623957c90fdf609fd22ef6d6a64f8e2217fd73b9051cac83900a6723a1 Sep 10 18:44:15.145950 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:15.145927 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4bbfb4b4-jjgs6"] Sep 10 18:44:15.147812 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:44:15.147775 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76cb7cc_7930_479f_93b9_194ac68ce779.slice/crio-532c705ba559fa7a8d85ae8f9b6cd3cec97712ef3a8fe679d890eb628fabd72a WatchSource:0}: Error finding container 532c705ba559fa7a8d85ae8f9b6cd3cec97712ef3a8fe679d890eb628fabd72a: Status 404 returned error can't find the container with id 532c705ba559fa7a8d85ae8f9b6cd3cec97712ef3a8fe679d890eb628fabd72a Sep 10 18:44:15.189438 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:15.189404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" event={"ID":"b76cb7cc-7930-479f-93b9-194ac68ce779","Type":"ContainerStarted","Data":"532c705ba559fa7a8d85ae8f9b6cd3cec97712ef3a8fe679d890eb628fabd72a"} Sep 10 18:44:15.190765 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:15.190740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699cbb7594-7hmnq" event={"ID":"26a752a3-9e6c-4dfa-a91b-b23da45c125b","Type":"ContainerStarted","Data":"06cfd8623957c90fdf609fd22ef6d6a64f8e2217fd73b9051cac83900a6723a1"} Sep 10 18:44:17.659066 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:17.659013 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 18:44:18.216406 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.216372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" event={"ID":"b76cb7cc-7930-479f-93b9-194ac68ce779","Type":"ContainerStarted","Data":"896d6ebf751bffc02c9a67528b2eabbadcb36fc921cbdd61504556c71395ffd5"} Sep 10 18:44:18.216601 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.216483 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:18.218118 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.218087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699cbb7594-7hmnq" event={"ID":"26a752a3-9e6c-4dfa-a91b-b23da45c125b","Type":"ContainerStarted","Data":"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209"} Sep 10 18:44:18.218259 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.218211 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:18.236127 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.236076 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" podStartSLOduration=2.729520418 podStartE2EDuration="5.236045281s" totalImagesPullingTime="2.506524863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:44:18.234704102 +0000 UTC m=+782.068019676" watchObservedRunningTime="2026-09-10 18:44:18.236045281 +0000 UTC m=+782.069360854" Sep 10 18:44:18.251421 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:18.251373 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-699cbb7594-7hmnq" podStartSLOduration=2.56279919 podStartE2EDuration="5.251354188s" totalImagesPullingTime="2.688554998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:44:18.2506021 +0000 UTC m=+782.083917675" watchObservedRunningTime="2026-09-10 18:44:18.251354188 +0000 UTC m=+782.084669763" Sep 10 18:44:29.226192 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.226162 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b4bbfb4b4-jjgs6" Sep 10 18:44:29.226604 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.226237 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:29.287402 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.287365 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:29.287596 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.287564 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-699cbb7594-7hmnq" podUID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" containerName="manager" containerID="cri-o://6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209" gracePeriod=30 Sep 10 18:44:29.535533 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.535508 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:29.554156 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.553997 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") pod \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " Sep 10 18:44:29.554156 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.554108 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs\") pod \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " Sep 10 18:44:29.554411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.554384 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88bh9\" (UniqueName: \"kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9\") pod \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\" (UID: \"26a752a3-9e6c-4dfa-a91b-b23da45c125b\") " Sep 10 18:44:29.556666 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.556629 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "26a752a3-9e6c-4dfa-a91b-b23da45c125b" (UID: "26a752a3-9e6c-4dfa-a91b-b23da45c125b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:44:29.556795 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.556771 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9" (OuterVolumeSpecName: "kube-api-access-88bh9") pod "26a752a3-9e6c-4dfa-a91b-b23da45c125b" (UID: "26a752a3-9e6c-4dfa-a91b-b23da45c125b"). InnerVolumeSpecName "kube-api-access-88bh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 18:44:29.556858 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.556782 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "26a752a3-9e6c-4dfa-a91b-b23da45c125b" (UID: "26a752a3-9e6c-4dfa-a91b-b23da45c125b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 18:44:29.655523 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.655474 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-metrics-certs\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:44:29.655523 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.655516 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88bh9\" (UniqueName: \"kubernetes.io/projected/26a752a3-9e6c-4dfa-a91b-b23da45c125b-kube-api-access-88bh9\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:44:29.655523 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:29.655530 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26a752a3-9e6c-4dfa-a91b-b23da45c125b-webhook-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Sep 10 18:44:30.284922 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.284886 2579 generic.go:356] "Generic (PLEG): container finished" podID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" containerID="6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209" exitCode=0 Sep 10 18:44:30.285372 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.284927 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699cbb7594-7hmnq" Sep 10 18:44:30.285372 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.284976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699cbb7594-7hmnq" event={"ID":"26a752a3-9e6c-4dfa-a91b-b23da45c125b","Type":"ContainerDied","Data":"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209"} Sep 10 18:44:30.285372 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.285028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699cbb7594-7hmnq" event={"ID":"26a752a3-9e6c-4dfa-a91b-b23da45c125b","Type":"ContainerDied","Data":"06cfd8623957c90fdf609fd22ef6d6a64f8e2217fd73b9051cac83900a6723a1"} Sep 10 18:44:30.285372 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.285051 2579 scope.go:117] "RemoveContainer" containerID="6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209" Sep 10 18:44:30.294729 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.294618 2579 scope.go:117] "RemoveContainer" containerID="6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209" Sep 10 18:44:30.294965 ip-10-0-130-133 kubenswrapper[2579]: E0910 18:44:30.294944 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209\": container with ID starting with 6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209 not found: ID does not exist" containerID="6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209" Sep 10 18:44:30.295011 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.294975 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209"} err="failed to get container status \"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209\": rpc error: code = NotFound desc = could not find container \"6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209\": container with ID starting with 6652bc8de797bfacd6460d3aacb4701cbacb9b6dce0198d92f9cb4d86da76209 not found: ID does not exist" Sep 10 18:44:30.306949 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.306904 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:30.310524 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.310496 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-699cbb7594-7hmnq"] Sep 10 18:44:30.696492 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:30.696450 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" path="/var/lib/kubelet/pods/26a752a3-9e6c-4dfa-a91b-b23da45c125b/volumes" Sep 10 18:44:53.489429 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.489347 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd"] Sep 10 18:44:53.489895 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.489704 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" containerName="manager" Sep 10 18:44:53.489895 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.489715 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" containerName="manager" Sep 10 18:44:53.489895 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.489790 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a752a3-9e6c-4dfa-a91b-b23da45c125b" containerName="manager" Sep 10 18:44:53.496290 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.496225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.501639 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.501570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 18:44:53.506442 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.506382 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd"] Sep 10 18:44:53.535731 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.535677 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vj9ff"] Sep 10 18:44:53.539196 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.539176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.542045 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.542019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-knzd4\"" Sep 10 18:44:53.550608 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.550582 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vj9ff"] Sep 10 18:44:53.563500 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.563456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65ggq\" (UniqueName: \"kubernetes.io/projected/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-kube-api-access-65ggq\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.563500 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.563505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.664962 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.664928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65ggq\" (UniqueName: \"kubernetes.io/projected/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-kube-api-access-65ggq\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.664962 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.664966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hfk\" (UniqueName: \"kubernetes.io/projected/cf9671cf-fa49-4d6f-af55-a82f543de5d8-kube-api-access-f4hfk\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.665242 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.664988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.665242 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.665135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf9671cf-fa49-4d6f-af55-a82f543de5d8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.665765 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.665745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.676880 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.676851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65ggq\" (UniqueName: \"kubernetes.io/projected/f87aca53-6eb1-4b7d-820f-4bae22fbd9dc-kube-api-access-65ggq\") pod \"payload-pre-processing-59fbc47bf8-xhwbd\" (UID: \"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.766181 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.766041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hfk\" (UniqueName: \"kubernetes.io/projected/cf9671cf-fa49-4d6f-af55-a82f543de5d8-kube-api-access-f4hfk\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.766338 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.766251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf9671cf-fa49-4d6f-af55-a82f543de5d8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.767138 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.767109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf9671cf-fa49-4d6f-af55-a82f543de5d8-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.775574 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.775543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hfk\" (UniqueName: \"kubernetes.io/projected/cf9671cf-fa49-4d6f-af55-a82f543de5d8-kube-api-access-f4hfk\") pod \"payload-processing-5b54b7fbb7-vj9ff\" (UID: \"cf9671cf-fa49-4d6f-af55-a82f543de5d8\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:53.818244 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.818209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:53.850554 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:53.850519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:54.090606 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:54.090575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd"] Sep 10 18:44:54.091868 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:44:54.091832 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87aca53_6eb1_4b7d_820f_4bae22fbd9dc.slice/crio-9982fff01e95f095bb5cea93d79ff91ebd8fed2f7db0a303f9852b21d5e74ad6 WatchSource:0}: Error finding container 9982fff01e95f095bb5cea93d79ff91ebd8fed2f7db0a303f9852b21d5e74ad6: Status 404 returned error can't find the container with id 9982fff01e95f095bb5cea93d79ff91ebd8fed2f7db0a303f9852b21d5e74ad6 Sep 10 18:44:54.129771 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:54.129742 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vj9ff"] Sep 10 18:44:54.131466 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:44:54.131435 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9671cf_fa49_4d6f_af55_a82f543de5d8.slice/crio-e8b5bc56e74f68603b554ff5b2739857499d626dce310f0a01d08b9f3d48d3ef WatchSource:0}: Error finding container e8b5bc56e74f68603b554ff5b2739857499d626dce310f0a01d08b9f3d48d3ef: Status 404 returned error can't find the container with id e8b5bc56e74f68603b554ff5b2739857499d626dce310f0a01d08b9f3d48d3ef Sep 10 18:44:54.415842 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:54.415754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" event={"ID":"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc","Type":"ContainerStarted","Data":"9982fff01e95f095bb5cea93d79ff91ebd8fed2f7db0a303f9852b21d5e74ad6"} Sep 10 18:44:54.417046 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:54.417022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" event={"ID":"cf9671cf-fa49-4d6f-af55-a82f543de5d8","Type":"ContainerStarted","Data":"e8b5bc56e74f68603b554ff5b2739857499d626dce310f0a01d08b9f3d48d3ef"} Sep 10 18:44:56.429172 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.429134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" event={"ID":"f87aca53-6eb1-4b7d-820f-4bae22fbd9dc","Type":"ContainerStarted","Data":"bc9ff0335ab34d2e3a496630c608fba9e83324128008fa290b47e20b1ccdeeca"} Sep 10 18:44:56.429677 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.429208 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:44:56.430863 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.430834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" event={"ID":"cf9671cf-fa49-4d6f-af55-a82f543de5d8","Type":"ContainerStarted","Data":"e84e72761ff9f0109900f1d9d3adb9934d17f5e3e68132303267b0ec8d7df710"} Sep 10 18:44:56.430981 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.430888 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:44:56.447184 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.447114 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" podStartSLOduration=1.527237199 podStartE2EDuration="3.44709356s" totalImagesPullingTime="1.919856361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:44:56.443826106 +0000 UTC m=+820.277141683" watchObservedRunningTime="2026-09-10 18:44:56.44709356 +0000 UTC m=+820.280409139" Sep 10 18:44:56.461028 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:44:56.460977 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" podStartSLOduration=1.588351525 podStartE2EDuration="3.460961056s" totalImagesPullingTime="1.872609531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:44:56.458720897 +0000 UTC m=+820.292036474" watchObservedRunningTime="2026-09-10 18:44:56.460961056 +0000 UTC m=+820.294276635" Sep 10 18:45:00.138974 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.138937 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx"] Sep 10 18:45:00.142626 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.142600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" Sep 10 18:45:00.145215 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.145189 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9vsbq\"" Sep 10 18:45:00.150240 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.150215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx"] Sep 10 18:45:00.154748 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.154728 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" Sep 10 18:45:00.425359 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.425333 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx"] Sep 10 18:45:00.427233 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:45:00.427207 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ede5a3_4940_4d57_9a37_f8fe0e9d9177.slice/crio-6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc WatchSource:0}: Error finding container 6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc: Status 404 returned error can't find the container with id 6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc Sep 10 18:45:00.451719 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:00.451686 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" event={"ID":"74ede5a3-4940-4d57-9a37-f8fe0e9d9177","Type":"ContainerStarted","Data":"6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc"} Sep 10 18:45:03.469792 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:03.469756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" event={"ID":"74ede5a3-4940-4d57-9a37-f8fe0e9d9177","Type":"ContainerStarted","Data":"fa2ad4ea78a369818b6a30fc15570c26f7d203621727d95843e4222a41e84ebd"} Sep 10 18:45:03.484840 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:03.484788 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" podStartSLOduration=0.997208277 podStartE2EDuration="3.484771871s" totalImagesPullingTime="2.487563594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:45:03.483462454 +0000 UTC m=+827.316778037" watchObservedRunningTime="2026-09-10 18:45:03.484771871 +0000 UTC m=+827.318087448" Sep 10 18:45:04.483425 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:04.483383 2579 generic.go:356] "Generic (PLEG): container finished" podID="74ede5a3-4940-4d57-9a37-f8fe0e9d9177" containerID="fa2ad4ea78a369818b6a30fc15570c26f7d203621727d95843e4222a41e84ebd" exitCode=0 Sep 10 18:45:04.483787 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:04.483455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" event={"ID":"74ede5a3-4940-4d57-9a37-f8fe0e9d9177","Type":"ContainerDied","Data":"fa2ad4ea78a369818b6a30fc15570c26f7d203621727d95843e4222a41e84ebd"} Sep 10 18:45:05.612640 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:05.612617 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" Sep 10 18:45:06.496827 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:06.496784 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" Sep 10 18:45:06.496827 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:06.496815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817765-lcpnx" event={"ID":"74ede5a3-4940-4d57-9a37-f8fe0e9d9177","Type":"ContainerDied","Data":"6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc"} Sep 10 18:45:06.497041 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:06.496871 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a8c6128d07f48a6810295a580591980955882dd8c44ea989b55dd600c191afc" Sep 10 18:45:07.438843 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:07.438806 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xhwbd" Sep 10 18:45:07.439317 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:07.438880 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vj9ff" Sep 10 18:45:46.156147 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.156109 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4"] Sep 10 18:45:46.156765 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.156688 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ede5a3-4940-4d57-9a37-f8fe0e9d9177" containerName="cleanup" Sep 10 18:45:46.156765 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.156710 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ede5a3-4940-4d57-9a37-f8fe0e9d9177" containerName="cleanup" Sep 10 18:45:46.156888 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.156798 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ede5a3-4940-4d57-9a37-f8fe0e9d9177" containerName="cleanup" Sep 10 18:45:46.159981 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.159961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.164003 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.163979 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9zgnh\"" Sep 10 18:45:46.164312 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.164298 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 18:45:46.164411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.164321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 18:45:46.164411 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.164300 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 18:45:46.168714 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.168691 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4"] Sep 10 18:45:46.338111 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.338111 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6znq\" (UniqueName: \"kubernetes.io/projected/19edce27-f421-4926-8236-d676161e18c3-kube-api-access-l6znq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.338459 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.338459 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.338459 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19edce27-f421-4926-8236-d676161e18c3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.338459 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.338386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439160 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6znq\" (UniqueName: \"kubernetes.io/projected/19edce27-f421-4926-8236-d676161e18c3-kube-api-access-l6znq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19edce27-f421-4926-8236-d676161e18c3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439663 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.439883 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.440022 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.439931 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.441707 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.441683 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19edce27-f421-4926-8236-d676161e18c3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.441876 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.441859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19edce27-f421-4926-8236-d676161e18c3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.446847 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.446822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6znq\" (UniqueName: \"kubernetes.io/projected/19edce27-f421-4926-8236-d676161e18c3-kube-api-access-l6znq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4\" (UID: \"19edce27-f421-4926-8236-d676161e18c3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.471923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.471872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:46.745469 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:46.745439 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4"] Sep 10 18:45:46.746480 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:45:46.746454 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19edce27_f421_4926_8236_d676161e18c3.slice/crio-af254b7381701a530a4968816284476abc29237e1fdecda168d812d0b41d584a WatchSource:0}: Error finding container af254b7381701a530a4968816284476abc29237e1fdecda168d812d0b41d584a: Status 404 returned error can't find the container with id af254b7381701a530a4968816284476abc29237e1fdecda168d812d0b41d584a Sep 10 18:45:47.723763 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:47.723732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" event={"ID":"19edce27-f421-4926-8236-d676161e18c3","Type":"ContainerStarted","Data":"af254b7381701a530a4968816284476abc29237e1fdecda168d812d0b41d584a"} Sep 10 18:45:48.730424 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:48.730385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" event={"ID":"19edce27-f421-4926-8236-d676161e18c3","Type":"ContainerStarted","Data":"7569352769a2b177a78f00c01c579e48e7178bb346317c15943f5f33660d17ea"} Sep 10 18:45:48.748975 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:48.748919 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" podStartSLOduration=1.775747859 podStartE2EDuration="2.748901683s" totalImagesPullingTime="973.153824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:45:48.74631116 +0000 UTC m=+872.579626734" watchObservedRunningTime="2026-09-10 18:45:48.748901683 +0000 UTC m=+872.582217257" Sep 10 18:45:56.472957 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:56.472921 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:56.473488 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:56.473012 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:56.485697 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:56.485668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:45:56.783924 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:45:56.783841 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4" Sep 10 18:46:04.340663 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.340629 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk"] Sep 10 18:46:04.344430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.344408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.347173 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.347143 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 18:46:04.355245 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.355222 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk"] Sep 10 18:46:04.403143 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.403257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.403257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvpw\" (UniqueName: \"kubernetes.io/projected/d260b044-6ea0-44a9-9b02-f822822fec8c-kube-api-access-7hvpw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.403356 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d260b044-6ea0-44a9-9b02-f822822fec8c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.403412 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.403412 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.403379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504265 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvpw\" (UniqueName: \"kubernetes.io/projected/d260b044-6ea0-44a9-9b02-f822822fec8c-kube-api-access-7hvpw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504400 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d260b044-6ea0-44a9-9b02-f822822fec8c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504701 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504758 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504706 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.504758 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.504746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.506601 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.506577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d260b044-6ea0-44a9-9b02-f822822fec8c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.506875 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.506856 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d260b044-6ea0-44a9-9b02-f822822fec8c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.511548 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.511527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvpw\" (UniqueName: \"kubernetes.io/projected/d260b044-6ea0-44a9-9b02-f822822fec8c-kube-api-access-7hvpw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk\" (UID: \"d260b044-6ea0-44a9-9b02-f822822fec8c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.685218 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.685163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:04.956379 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:04.956351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk"] Sep 10 18:46:04.957329 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:46:04.957306 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd260b044_6ea0_44a9_9b02_f822822fec8c.slice/crio-66c666a9fd249b65632ae48cf9ca3c02f8f954b702b10b3c47644bb9b2492ab0 WatchSource:0}: Error finding container 66c666a9fd249b65632ae48cf9ca3c02f8f954b702b10b3c47644bb9b2492ab0: Status 404 returned error can't find the container with id 66c666a9fd249b65632ae48cf9ca3c02f8f954b702b10b3c47644bb9b2492ab0 Sep 10 18:46:05.825264 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:05.825228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" event={"ID":"d260b044-6ea0-44a9-9b02-f822822fec8c","Type":"ContainerStarted","Data":"1585f5c2376c25a29a69e63d99b02296c5c214142f55c10804088f974b470ba7"} Sep 10 18:46:05.825664 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:05.825284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" event={"ID":"d260b044-6ea0-44a9-9b02-f822822fec8c","Type":"ContainerStarted","Data":"66c666a9fd249b65632ae48cf9ca3c02f8f954b702b10b3c47644bb9b2492ab0"} Sep 10 18:46:05.844710 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:05.844663 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" podStartSLOduration=1.6659512140000001 podStartE2EDuration="1.8446475s" totalImagesPullingTime="178.696286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:46:05.841575091 +0000 UTC m=+889.674890680" watchObservedRunningTime="2026-09-10 18:46:05.8446475 +0000 UTC m=+889.677963107" Sep 10 18:46:14.685381 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:14.685282 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:14.685381 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:14.685363 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:14.698431 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:14.698402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:14.888072 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:14.888021 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk" Sep 10 18:46:16.695287 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:16.695259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:46:16.696051 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:46:16.696015 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:50:14.830790 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:14.830751 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b4bbfb4b4-jjgs6_b76cb7cc-7930-479f-93b9-194ac68ce779/manager/0.log" Sep 10 18:50:15.539050 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:15.539014 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b_06278012-6830-4bff-b3dc-d5e1db3bc575/copy-manifests/0.log" Sep 10 18:50:15.544890 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:15.544867 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b_06278012-6830-4bff-b3dc-d5e1db3bc575/manager/0.log" Sep 10 18:50:16.045430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:16.045395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817765-lcpnx_74ede5a3-4940-4d57-9a37-f8fe0e9d9177/cleanup/0.log" Sep 10 18:50:18.037585 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:18.037546 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd_f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf/istio-proxy/0.log" Sep 10 18:50:18.153764 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:18.153731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6rvxh_aec46b3a-90e5-4dcd-aeb5-24995e1984aa/discovery/0.log" Sep 10 18:50:18.594943 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:18.594912 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xhwbd_f87aca53-6eb1-4b7d-820f-4bae22fbd9dc/payload-pre-processing/0.log" Sep 10 18:50:18.718244 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:18.718213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vj9ff_cf9671cf-fa49-4d6f-af55-a82f543de5d8/payload-processing/0.log" Sep 10 18:50:18.840014 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:18.839985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55f66b6d-slj2l_318e4e83-d575-4bd1-9a2e-76bf5be2b47a/router/0.log" Sep 10 18:50:19.449430 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:19.449385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-wtfw4_19edce27-f421-4926-8236-d676161e18c3/main/0.log" Sep 10 18:50:19.688133 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:19.688103 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6pvgk_d260b044-6ea0-44a9-9b02-f822822fec8c/main/0.log" Sep 10 18:50:29.089719 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:29.089684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22lxr_f99c2cd7-f34d-400b-8e20-0f1cdf38e95c/global-pull-secret-syncer/0.log" Sep 10 18:50:29.226682 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:29.226652 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxzql_9c6706f9-b195-4f6d-9a6a-375dd10c75f4/konnectivity-agent/0.log" Sep 10 18:50:29.269074 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:29.269035 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-133.ec2.internal_6f9cfc38a9d54d6881403da441b0a834/haproxy/0.log" Sep 10 18:50:36.246517 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.246482 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-xv6jn_155cc9f5-5a88-40a8-bbe0-2fa163cc850b/cluster-monitoring-operator/0.log" Sep 10 18:50:36.280196 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.280164 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-4lk45_733cacc3-d3e3-4089-983b-f5e4ac9576a3/kube-state-metrics/0.log" Sep 10 18:50:36.297151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.297127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-4lk45_733cacc3-d3e3-4089-983b-f5e4ac9576a3/kube-rbac-proxy-main/0.log" Sep 10 18:50:36.323682 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.323652 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-4lk45_733cacc3-d3e3-4089-983b-f5e4ac9576a3/kube-rbac-proxy-self/0.log" Sep 10 18:50:36.351908 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.351882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d87dd6979-nnvvv_78d49465-553b-4218-8760-73341c4cbdfd/metrics-server/0.log" Sep 10 18:50:36.515270 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.515190 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxjvp_9b7f9cab-cf6c-4702-9004-d90944b842f7/node-exporter/0.log" Sep 10 18:50:36.534284 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.534259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxjvp_9b7f9cab-cf6c-4702-9004-d90944b842f7/kube-rbac-proxy/0.log" Sep 10 18:50:36.552704 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.552683 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxjvp_9b7f9cab-cf6c-4702-9004-d90944b842f7/init-textfile/0.log" Sep 10 18:50:36.665074 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.665036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rn7vj_09fc6411-60c3-4c13-980e-8da6d08a1901/kube-rbac-proxy-main/0.log" Sep 10 18:50:36.690737 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.690684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rn7vj_09fc6411-60c3-4c13-980e-8da6d08a1901/kube-rbac-proxy-self/0.log" Sep 10 18:50:36.712864 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:36.712834 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-rn7vj_09fc6411-60c3-4c13-980e-8da6d08a1901/openshift-state-metrics/0.log" Sep 10 18:50:37.092806 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.092782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/thanos-query/0.log" Sep 10 18:50:37.114104 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.114077 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/kube-rbac-proxy-web/0.log" Sep 10 18:50:37.132707 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.132677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/kube-rbac-proxy/0.log" Sep 10 18:50:37.154933 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.154902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/prom-label-proxy/0.log" Sep 10 18:50:37.176277 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.176223 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/kube-rbac-proxy-rules/0.log" Sep 10 18:50:37.199151 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:37.199088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b99b895f-mvkp5_523c3e35-bbb7-41e6-a871-73a7e399a739/kube-rbac-proxy-metrics/0.log" Sep 10 18:50:39.125997 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.125891 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b"] Sep 10 18:50:39.129768 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.129748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.132625 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.132600 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ddcqf\"/\"openshift-service-ca.crt\"" Sep 10 18:50:39.134096 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.134073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ddcqf\"/\"kube-root-ca.crt\"" Sep 10 18:50:39.134220 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.134079 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ddcqf\"/\"default-dockercfg-bf9tb\"" Sep 10 18:50:39.138226 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.138204 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b"] Sep 10 18:50:39.246604 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.246561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-sys\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.246604 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.246609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-lib-modules\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.246861 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.246635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-podres\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.246861 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.246724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9cz\" (UniqueName: \"kubernetes.io/projected/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-kube-api-access-8n9cz\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.246861 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.246814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-proc\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347447 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-podres\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9cz\" (UniqueName: \"kubernetes.io/projected/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-kube-api-access-8n9cz\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-proc\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-sys\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-lib-modules\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347590 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-podres\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347636 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347616 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-proc\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347849 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-sys\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.347849 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.347689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-lib-modules\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.355810 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.355777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9cz\" (UniqueName: \"kubernetes.io/projected/4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4-kube-api-access-8n9cz\") pod \"perf-node-gather-daemonset-tjz4b\" (UID: \"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4\") " pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.440590 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.440488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:39.660044 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.660013 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d5d644fbc-dcz5r_a20ae8bc-fa25-49ee-b34b-7475c39c0a1c/console/0.log" Sep 10 18:50:39.713097 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:39.713051 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b"] Sep 10 18:50:39.714126 ip-10-0-130-133 kubenswrapper[2579]: W0910 18:50:39.714094 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4b21d7a9_2f9e_471c_ad68_d6fdc452e8f4.slice/crio-59efe8b1777d14cad02fb6da185f4d278c4f3e8c7253ddbcd22e517081641852 WatchSource:0}: Error finding container 59efe8b1777d14cad02fb6da185f4d278c4f3e8c7253ddbcd22e517081641852: Status 404 returned error can't find the container with id 59efe8b1777d14cad02fb6da185f4d278c4f3e8c7253ddbcd22e517081641852 Sep 10 18:50:40.354355 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:40.354316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" event={"ID":"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4","Type":"ContainerStarted","Data":"5a1b797a5cfae9731162faaeed440dbc4ebf14cec2b1267c4172c93a1c17f123"} Sep 10 18:50:40.354791 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:40.354473 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:40.354791 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:40.354493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" event={"ID":"4b21d7a9-2f9e-471c-ad68-d6fdc452e8f4","Type":"ContainerStarted","Data":"59efe8b1777d14cad02fb6da185f4d278c4f3e8c7253ddbcd22e517081641852"} Sep 10 18:50:40.371329 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:40.371267 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" podStartSLOduration=1.3712500109999999 podStartE2EDuration="1.371250011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:50:40.369681155 +0000 UTC m=+1164.202996726" watchObservedRunningTime="2026-09-10 18:50:40.371250011 +0000 UTC m=+1164.204565603" Sep 10 18:50:41.385030 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:41.385002 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-72vfr_b7909b9f-509e-44dd-bee7-26c83608452c/dns/0.log" Sep 10 18:50:41.404042 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:41.404017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-72vfr_b7909b9f-509e-44dd-bee7-26c83608452c/kube-rbac-proxy/0.log" Sep 10 18:50:41.490782 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:41.490745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9d7bm_b396a88f-79df-4aa7-a136-19146def7c13/dns-node-resolver/0.log" Sep 10 18:50:42.126352 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:42.126314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f8rtw_5dbfad1a-734c-497e-bd8b-fa4326c5d24a/node-ca/0.log" Sep 10 18:50:43.048589 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.048556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd_f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf/istio-proxy/0.log" Sep 10 18:50:43.097612 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.097579 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6rvxh_aec46b3a-90e5-4dcd-aeb5-24995e1984aa/discovery/0.log" Sep 10 18:50:43.183652 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.183623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xhwbd_f87aca53-6eb1-4b7d-820f-4bae22fbd9dc/payload-pre-processing/0.log" Sep 10 18:50:43.204998 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.204961 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vj9ff_cf9671cf-fa49-4d6f-af55-a82f543de5d8/payload-processing/0.log" Sep 10 18:50:43.227716 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.227687 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55f66b6d-slj2l_318e4e83-d575-4bd1-9a2e-76bf5be2b47a/router/0.log" Sep 10 18:50:43.822497 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:43.822464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sdjc_dce5b0a7-24c2-434f-bc84-e9c4b3842545/serve-healthcheck-canary/0.log" Sep 10 18:50:44.307974 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:44.307922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-k5xkt_2a22b7a8-59d7-4760-a946-46cfb89023fe/insights-operator/1.log" Sep 10 18:50:44.308472 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:44.308046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-k5xkt_2a22b7a8-59d7-4760-a946-46cfb89023fe/insights-operator/0.log" Sep 10 18:50:44.444416 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:44.444382 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcbhs_a62847e4-e3ac-44fb-90d0-5998c25cbe02/kube-rbac-proxy/0.log" Sep 10 18:50:44.463298 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:44.463272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcbhs_a62847e4-e3ac-44fb-90d0-5998c25cbe02/exporter/0.log" Sep 10 18:50:44.481885 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:44.481862 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rcbhs_a62847e4-e3ac-44fb-90d0-5998c25cbe02/extractor/0.log" Sep 10 18:50:46.370176 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:46.370149 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ddcqf/perf-node-gather-daemonset-tjz4b" Sep 10 18:50:46.598754 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:46.598719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b4bbfb4b4-jjgs6_b76cb7cc-7930-479f-93b9-194ac68ce779/manager/0.log" Sep 10 18:50:46.785595 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:46.785512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b_06278012-6830-4bff-b3dc-d5e1db3bc575/manager/0.log" Sep 10 18:50:46.803467 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:46.803441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb8cfcdd6-wgt6b_06278012-6830-4bff-b3dc-d5e1db3bc575/copy-manifests/0.log" Sep 10 18:50:48.055923 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:48.055831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-ddb978bf8-vt7q9_30fbf3d2-c835-4267-8720-76b28eb4476c/manager/0.log" Sep 10 18:50:49.968425 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:49.968392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd_f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf/istio-proxy/0.log" Sep 10 18:50:50.003680 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:50.003647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6rvxh_aec46b3a-90e5-4dcd-aeb5-24995e1984aa/discovery/0.log" Sep 10 18:50:50.064729 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:50.064702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xhwbd_f87aca53-6eb1-4b7d-820f-4bae22fbd9dc/payload-pre-processing/0.log" Sep 10 18:50:50.079948 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:50.079921 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vj9ff_cf9671cf-fa49-4d6f-af55-a82f543de5d8/payload-processing/0.log" Sep 10 18:50:50.096653 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:50.096623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55f66b6d-slj2l_318e4e83-d575-4bd1-9a2e-76bf5be2b47a/router/0.log" Sep 10 18:50:51.340990 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:51.340958 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-phcsd_f6d6f650-320c-4ba3-8a33-c2d07e5dc1cf/istio-proxy/0.log" Sep 10 18:50:51.381114 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:51.381086 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6rvxh_aec46b3a-90e5-4dcd-aeb5-24995e1984aa/discovery/0.log" Sep 10 18:50:51.456259 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:51.456221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xhwbd_f87aca53-6eb1-4b7d-820f-4bae22fbd9dc/payload-pre-processing/0.log" Sep 10 18:50:51.471591 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:51.471562 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vj9ff_cf9671cf-fa49-4d6f-af55-a82f543de5d8/payload-processing/0.log" Sep 10 18:50:51.490776 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:51.490733 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55f66b6d-slj2l_318e4e83-d575-4bd1-9a2e-76bf5be2b47a/router/0.log" Sep 10 18:50:54.662040 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.662013 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9cl5z_5a5aaf21-3227-4944-8ac7-5a6c45ac6c2a/kube-multus/0.log" Sep 10 18:50:54.684562 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.684531 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/kube-multus-additional-cni-plugins/0.log" Sep 10 18:50:54.702632 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.702605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/egress-router-binary-copy/0.log" Sep 10 18:50:54.720594 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.720565 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/cni-plugins/0.log" Sep 10 18:50:54.738441 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.738413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/bond-cni-plugin/0.log" Sep 10 18:50:54.756299 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.756268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/routeoverride-cni/0.log" Sep 10 18:50:54.773841 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.773793 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/whereabouts-cni-bincopy/0.log" Sep 10 18:50:54.791337 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:54.791312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhwrm_8a1744af-af41-4f82-a5d6-210344b45a3b/whereabouts-cni/0.log" Sep 10 18:50:55.192485 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:55.192454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rh4jl_6ec1c3fe-2dd8-48df-b3fe-322ee22f714a/network-metrics-daemon/0.log" Sep 10 18:50:55.211084 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:55.211032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rh4jl_6ec1c3fe-2dd8-48df-b3fe-322ee22f714a/kube-rbac-proxy/0.log" Sep 10 18:50:56.159205 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.159119 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-controller/0.log" Sep 10 18:50:56.175257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.175223 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/0.log" Sep 10 18:50:56.175257 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.175251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovn-acl-logging/1.log" Sep 10 18:50:56.194682 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.194650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/kube-rbac-proxy-node/0.log" Sep 10 18:50:56.213614 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.213589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 18:50:56.230381 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.230357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/northd/0.log" Sep 10 18:50:56.248171 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.248107 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/nbdb/0.log" Sep 10 18:50:56.265769 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.265742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/sbdb/0.log" Sep 10 18:50:56.299872 ip-10-0-130-133 kubenswrapper[2579]: I0910 18:50:56.299842 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hhz7s_b5384087-b807-40a4-a982-6ca6df7050bd/ovnkube-controller/0.log"