Sep 17 03:29:31.106725 ip-10-0-129-170 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 03:29:31.106741 ip-10-0-129-170 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 03:29:31.106752 ip-10-0-129-170 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 03:29:31.106952 ip-10-0-129-170 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 03:29:41.294019 ip-10-0-129-170 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 03:29:41.294042 ip-10-0-129-170 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1aeb403f3aa74c36baad1756e007a5f9 -- Sep 17 03:31:11.792661 ip-10-0-129-170 systemd[1]: Starting Kubernetes Kubelet... Sep 17 03:31:12.245166 ip-10-0-129-170 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:31:12.245166 ip-10-0-129-170 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 03:31:12.245166 ip-10-0-129-170 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:31:12.245166 ip-10-0-129-170 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 03:31:12.245166 ip-10-0-129-170 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:31:12.247935 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.247849 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 03:31:12.252123 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252107 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.252123 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252122 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252126 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252129 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252132 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252136 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252139 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252141 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252144 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252149 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252153 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252156 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252159 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252165 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252168 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252171 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252173 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252176 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252179 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252181 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252185 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.252190 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252187 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252190 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252192 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252195 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252198 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252201 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252205 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252208 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252210 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252213 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252215 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252219 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252221 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252224 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252227 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252229 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252232 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252234 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252237 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.252682 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252240 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252242 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252245 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252247 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252250 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252252 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252255 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252257 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252259 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252262 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252264 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252267 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252269 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252273 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252276 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252279 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252281 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252284 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252288 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252290 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.253149 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252293 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252295 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252298 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252301 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252303 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252306 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252308 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252311 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252313 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252316 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252319 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252321 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252323 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252326 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252329 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252332 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252335 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252338 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252341 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252343 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.253656 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252357 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252360 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252363 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252365 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252368 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252371 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252374 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252378 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252382 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252385 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252387 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252390 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252394 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252397 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252401 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252404 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252407 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252409 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.252412 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.254136 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253084 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253090 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253093 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253096 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253098 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253101 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253104 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253107 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253110 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253112 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253116 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253118 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253121 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253123 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253129 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253131 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253134 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253138 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253142 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.254618 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253145 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253148 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253151 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253154 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253157 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253159 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253162 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253165 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253168 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253171 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253173 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253176 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253178 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253181 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253184 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253187 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253189 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253192 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253194 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253197 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.255089 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253199 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253202 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253207 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253211 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253214 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253216 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253219 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253223 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253226 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253228 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253231 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253234 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253236 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253239 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253242 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253244 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253247 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253250 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253253 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253255 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.255585 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253258 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253260 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253262 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253265 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253268 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253271 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253274 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253276 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253279 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253281 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253284 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253286 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253288 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253291 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253294 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253297 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253299 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253302 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253304 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253308 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.256080 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253311 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253313 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253316 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253318 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253321 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253324 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253326 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253329 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253332 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253334 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253337 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253339 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253342 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253359 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253363 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253367 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253370 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253373 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253375 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253378 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.256664 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253740 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253745 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253747 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253750 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253753 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253755 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253759 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253762 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253765 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253767 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253769 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253774 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253777 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253780 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253782 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253785 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253787 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253790 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253793 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.257161 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253796 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253799 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253802 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253804 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253806 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253809 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253811 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253814 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253816 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253819 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253821 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253824 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253826 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253829 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253831 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253833 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253837 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253841 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253844 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253847 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.257641 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253851 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253854 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253857 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253859 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253863 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253866 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253870 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253872 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253875 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253878 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253880 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253883 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253885 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253888 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253891 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253893 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253896 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253899 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253902 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.258129 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253904 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253907 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253909 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253912 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253914 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253917 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253919 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253922 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253924 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253926 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253929 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253931 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253934 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253936 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253939 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253942 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253944 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253948 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253951 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253955 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.258665 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253957 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253960 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253962 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253967 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253970 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253973 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253976 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253979 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253981 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253984 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253986 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253989 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253991 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253994 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253996 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.253998 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254001 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254004 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254006 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254009 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.259174 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254011 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254083 2557 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254124 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254131 2557 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254135 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254139 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254142 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254148 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254152 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254157 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254160 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254165 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254168 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254171 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254175 2557 flags.go:64] FLAG: --cgroup-root="" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254178 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254180 2557 flags.go:64] FLAG: --client-ca-file="" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254183 2557 flags.go:64] FLAG: --cloud-provider="external" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254186 2557 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254191 2557 flags.go:64] FLAG: --cluster-domain="" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254194 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254197 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254200 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254203 2557 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 03:31:12.259699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254207 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254210 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254213 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254216 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254219 2557 flags.go:64] FLAG: --contention-profiling="false" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254222 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254225 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254228 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254231 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254235 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254238 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254241 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254243 2557 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254246 2557 flags.go:64] FLAG: --enable-server="true" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254249 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254253 2557 flags.go:64] FLAG: --event-burst="100" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254257 2557 flags.go:64] FLAG: --event-qps="50" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254261 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254265 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254269 2557 flags.go:64] FLAG: --eviction-hard="" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254273 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254283 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254287 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254290 2557 flags.go:64] FLAG: --eviction-soft="" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254293 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 03:31:12.260264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254296 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254299 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254301 2557 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254304 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254307 2557 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254310 2557 flags.go:64] FLAG: --feature-gates="" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254314 2557 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254317 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254320 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254323 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254326 2557 flags.go:64] FLAG: --healthz-port="10248" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254329 2557 flags.go:64] FLAG: --help="false" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254332 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254335 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254338 2557 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254341 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254344 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254359 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254363 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254365 2557 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254368 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254371 2557 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254374 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254377 2557 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 03:31:12.260910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254382 2557 flags.go:64] FLAG: --kube-reserved="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254385 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254390 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254393 2557 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254396 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254399 2557 flags.go:64] FLAG: --lock-file="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254402 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254405 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254408 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254414 2557 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254417 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254420 2557 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254423 2557 flags.go:64] FLAG: --logging-format="text" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254426 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254429 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254432 2557 flags.go:64] FLAG: --manifest-url="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254435 2557 flags.go:64] FLAG: --manifest-url-header="" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254440 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254443 2557 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254446 2557 flags.go:64] FLAG: --max-pods="110" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254449 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254452 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254455 2557 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254458 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254461 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 03:31:12.261522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254464 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254467 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254474 2557 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254477 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254480 2557 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254483 2557 flags.go:64] FLAG: --pod-cidr="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254486 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254493 2557 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254496 2557 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254499 2557 flags.go:64] FLAG: --pods-per-core="0" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254503 2557 flags.go:64] FLAG: --port="10250" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254506 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254509 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0676b6ecdbfd76883" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254512 2557 flags.go:64] FLAG: --qos-reserved="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254515 2557 flags.go:64] FLAG: --read-only-port="10255" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254519 2557 flags.go:64] FLAG: --register-node="true" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254522 2557 flags.go:64] FLAG: --register-with-taints="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254525 2557 flags.go:64] FLAG: --registry-burst="10" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254528 2557 flags.go:64] FLAG: --registry-qps="5" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254531 2557 flags.go:64] FLAG: --reserved-cpus="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254534 2557 flags.go:64] FLAG: --reserved-memory="" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254537 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254541 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254544 2557 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254547 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 03:31:12.262412 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254550 2557 flags.go:64] FLAG: --runonce="false" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254553 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254556 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254559 2557 flags.go:64] FLAG: --seccomp-default="false" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254562 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254565 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254568 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254571 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254574 2557 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254577 2557 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254580 2557 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254582 2557 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254585 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254588 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254593 2557 flags.go:64] FLAG: --system-cgroups="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254596 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254601 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254606 2557 flags.go:64] FLAG: --tls-cert-file="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254608 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254621 2557 flags.go:64] FLAG: --tls-min-version="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254624 2557 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254627 2557 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254630 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254633 2557 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254636 2557 flags.go:64] FLAG: --v="2" Sep 17 03:31:12.263111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254645 2557 flags.go:64] FLAG: --version="false" Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254649 2557 flags.go:64] FLAG: --vmodule="" Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254653 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.254656 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254769 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254773 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254776 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254779 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254782 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254785 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254787 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254790 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254792 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254795 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254798 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254801 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254803 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254806 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254808 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254811 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.263777 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254814 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254817 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254820 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254822 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254827 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254830 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254833 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254835 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254838 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254841 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254843 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254846 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254849 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254851 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254854 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254856 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254859 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254862 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254864 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254867 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.264250 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254869 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254872 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254875 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254877 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254880 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254882 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254893 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254896 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254900 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254904 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254908 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254912 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254915 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254918 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254921 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254924 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254928 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254931 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254934 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.264754 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254937 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254940 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254943 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254946 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254949 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254952 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254955 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254959 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254963 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254966 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254969 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254972 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254976 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254979 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254982 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254985 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254987 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254990 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254992 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254996 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.265230 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.254998 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255001 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255004 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255006 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255009 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255012 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255015 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255017 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255020 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255024 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255027 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255030 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255033 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255035 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255038 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255041 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255043 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255046 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255049 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255051 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.265743 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255054 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255056 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255059 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.255062 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.255089 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.263779 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.263796 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.263816 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.263822 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263878 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263883 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263887 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263890 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263893 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.266245 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263896 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263899 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263902 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263905 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263908 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263911 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263914 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263917 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263921 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263924 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263927 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263930 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263932 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263935 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263937 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263940 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263943 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263945 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263949 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263951 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.266629 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263954 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263956 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263960 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263962 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263965 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263967 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263970 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263972 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263975 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263978 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263980 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263983 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263986 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263989 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263991 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263994 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263996 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.263999 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264002 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264004 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.267147 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264007 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264010 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264012 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264015 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264018 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264020 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264023 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264026 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264029 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264031 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264034 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264037 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264039 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264041 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264044 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264046 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264049 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264052 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264054 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264057 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.267652 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264060 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264063 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264065 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264068 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264070 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264073 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264075 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264078 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264081 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264083 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264086 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264089 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264091 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264094 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264097 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264100 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264102 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264105 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264107 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264110 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.268138 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264113 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264116 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264120 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264123 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264125 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264128 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264130 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264133 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264136 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264139 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264143 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264147 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264150 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264153 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.268628 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.264158 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264269 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264275 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264278 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264281 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264284 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264286 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264289 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264291 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264294 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264297 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264300 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264303 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264306 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264309 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264311 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264314 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264316 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264319 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264326 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:31:12.268991 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264328 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264331 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264333 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264336 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264339 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264341 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264344 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264362 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264367 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264372 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264375 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264378 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264380 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264383 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264386 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264389 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264392 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264394 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264397 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264400 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:31:12.269497 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264402 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264405 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264408 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264410 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264413 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264416 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264419 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264422 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264424 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264427 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264429 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264433 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264436 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264439 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264442 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264444 2557 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264447 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264449 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264452 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:31:12.269985 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264454 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264457 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264459 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264462 2557 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264465 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264468 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264471 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264473 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264476 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264479 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264481 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264484 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264487 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264489 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264492 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264494 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264497 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264500 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264502 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264505 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:31:12.270463 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264508 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264511 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264513 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264516 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264520 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264523 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264526 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264528 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264531 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264533 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264536 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264539 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264541 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264544 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264546 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264549 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264554 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264557 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264559 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264562 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:31:12.270963 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:12.264565 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.264570 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.264670 2557 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.268152 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.269197 2557 server.go:1019] "Starting client certificate rotation" Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.269298 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:31:12.271549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.269333 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:31:12.272585 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.272572 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:31:12.273778 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.273757 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:31:12.283052 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.283033 2557 log.go:25] "Validated CRI v1 runtime API" Sep 17 03:31:12.286250 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.286232 2557 log.go:25] "Validated CRI v1 image API" Sep 17 03:31:12.287136 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.287118 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 03:31:12.289821 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.289803 2557 fs.go:135] Filesystem UUIDs: map[19daaaa2-2866-4b78-abdb-fa085a042aa0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a0c62335-dffa-4971-8a4c-fdc4a02d30dd:/dev/nvme0n1p4] Sep 17 03:31:12.289891 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.289819 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 03:31:12.295875 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.295759 2557 manager.go:216] Machine: {Timestamp:2026-09-17 03:31:12.29521569 +0000 UTC m=+0.372765182 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132056 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fd09256fd7b11e7c3f6b126365459 SystemUUID:ec2fd092-56fd-7b11-e7c3-f6b126365459 BootID:1aeb403f-3aa7-4c36-baad-1756e007a5f9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:61:15:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:61:15:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:e6:41:cf:38:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 03:31:12.295875 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.295865 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 03:31:12.295983 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.295936 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 03:31:12.300246 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.300062 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 03:31:12.300452 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.300251 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 03:31:12.300544 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.300490 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:31:12.301893 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.301880 2557 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 03:31:12.301935 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.301896 2557 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 03:31:12.301935 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.301904 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:31:12.302814 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.302801 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:31:12.303927 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.303917 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 03:31:12.308079 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308067 2557 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:31:12.308190 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308181 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 03:31:12.308225 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308211 2557 kubelet.go:486] "Attempting to sync node with API server" Sep 17 03:31:12.308225 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308220 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 03:31:12.308280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308234 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 03:31:12.308280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308243 2557 kubelet.go:398] "Adding apiserver pod source" Sep 17 03:31:12.308280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308256 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 03:31:12.308636 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308620 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:31:12.308698 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.308641 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:31:12.310899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.310881 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 03:31:12.313738 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.313724 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 03:31:12.313840 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.313755 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 03:31:12.315761 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315748 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315765 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315770 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315776 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315789 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315798 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315813 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 03:31:12.315815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315818 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 03:31:12.316116 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315825 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 03:31:12.316116 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315830 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 03:31:12.316116 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315839 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 03:31:12.316116 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.315844 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 03:31:12.316636 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.316624 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 03:31:12.316636 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.316634 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 03:31:12.319065 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.319048 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-170.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 03:31:12.319137 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.319108 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 03:31:12.319344 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.319322 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 03:31:12.320511 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.320490 2557 server.go:1268] "Started kubelet" Sep 17 03:31:12.320587 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.320554 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 03:31:12.320650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.320558 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 03:31:12.320650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.320619 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 03:31:12.321287 ip-10-0-129-170 systemd[1]: Started Kubernetes Kubelet. Sep 17 03:31:12.322022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.322005 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 03:31:12.322635 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.322620 2557 server.go:310] "Adding debug handlers to kubelet server" Sep 17 03:31:12.324795 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.324767 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 03:31:12.327884 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.326667 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe27720fdad5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.320461525 +0000 UTC m=+0.398011018,LastTimestamp:2026-09-17 03:31:12.320461525 +0000 UTC m=+0.398011018,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.329167 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.329147 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 03:31:12.329883 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.329863 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 03:31:12.330187 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.330166 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.330889 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.330869 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 03:31:12.330889 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.330892 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 03:31:12.331034 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331022 2557 reconstruct.go:97] "Volume reconstruction finished" Sep 17 03:31:12.331034 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331034 2557 reconciler.go:29] "Reconciler: start to sync state" Sep 17 03:31:12.331156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331075 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 03:31:12.331156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331090 2557 factory.go:55] Registering systemd factory Sep 17 03:31:12.331156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331099 2557 factory.go:223] Registration of the systemd container factory successfully Sep 17 03:31:12.331317 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.330871 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 03:31:12.331371 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331332 2557 factory.go:153] Registering CRI-O factory Sep 17 03:31:12.331371 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331345 2557 factory.go:223] Registration of the crio container factory successfully Sep 17 03:31:12.331435 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331375 2557 factory.go:103] Registering Raw factory Sep 17 03:31:12.331435 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331385 2557 manager.go:1196] Started watching for new ooms in manager Sep 17 03:31:12.331889 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.331877 2557 manager.go:349] Starting recovery of all containers Sep 17 03:31:12.332969 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.332943 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 03:31:12.333065 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.333007 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 03:31:12.343110 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.343093 2557 manager.go:354] Recovery completed Sep 17 03:31:12.347384 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.347365 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.349402 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.349385 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.349446 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.349417 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.349446 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.349431 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.350139 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350121 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 03:31:12.350139 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350139 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 03:31:12.350236 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350144 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.350236 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350157 2557 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:31:12.350802 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350788 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.350882 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350815 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.350882 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.350831 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.351487 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.351475 2557 policy_none.go:49] "None policy: Start" Sep 17 03:31:12.351487 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.351490 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 03:31:12.351612 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.351499 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 03:31:12.351805 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.351729 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe2773c97dca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-170.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.349404618 +0000 UTC m=+0.426954116,LastTimestamp:2026-09-17 03:31:12.349404618 +0000 UTC m=+0.426954116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.352604 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.352580 2557 policy_none.go:47] "Start" Sep 17 03:31:12.361603 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.361544 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe2773c9c7b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-170.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.349423538 +0000 UTC m=+0.426973033,LastTimestamp:2026-09-17 03:31:12.349423538 +0000 UTC m=+0.426973033,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.363233 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.363180 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe2773c9feab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-170.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.349437611 +0000 UTC m=+0.426987105,LastTimestamp:2026-09-17 03:31:12.349437611 +0000 UTC m=+0.426987105,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.372409 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.372302 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-170.ec2.internal.18d5fe2773c97dca\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe2773c97dca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-170.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.349404618 +0000 UTC m=+0.426954116,LastTimestamp:2026-09-17 03:31:12.350800578 +0000 UTC m=+0.428350072,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.372999 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.372981 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bj9zp" Sep 17 03:31:12.379041 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.379023 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bj9zp" Sep 17 03:31:12.379941 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.379927 2557 manager.go:337] "Starting Device Plugin manager" Sep 17 03:31:12.380011 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.379963 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 03:31:12.380011 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.379972 2557 server.go:87] "Starting device plugin registration server" Sep 17 03:31:12.380217 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.380204 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 03:31:12.380298 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.380219 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 03:31:12.380298 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.380162 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-170.ec2.internal.18d5fe2773c9c7b2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-170.ec2.internal.18d5fe2773c9c7b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-170.ec2.internal,UID:ip-10-0-129-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-170.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-170.ec2.internal,},FirstTimestamp:2026-09-17 03:31:12.349423538 +0000 UTC m=+0.426973033,LastTimestamp:2026-09-17 03:31:12.350821376 +0000 UTC m=+0.428370870,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-170.ec2.internal,}" Sep 17 03:31:12.380611 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.380592 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 03:31:12.380913 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.380805 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 03:31:12.380913 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.380818 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 03:31:12.381921 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.381896 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 03:31:12.382012 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.381954 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.399247 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.400424 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.400467 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.400488 2557 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.400529 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 03:31:12.403797 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.402429 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:12.480847 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.480820 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.481765 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.481750 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.481818 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.481782 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.481818 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.481797 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.481885 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.481823 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.491429 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.491413 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.491515 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.491435 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-170.ec2.internal\": node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.500848 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.500793 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal"] Sep 17 03:31:12.500848 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.500848 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.502543 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.502529 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.502605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.502558 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.502605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.502569 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.503719 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.503708 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.503863 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.503850 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.503899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.503877 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.504413 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504387 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.504413 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504418 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.504551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504390 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.504551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504433 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.504551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504451 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.504551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.504467 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.505830 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.505815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.505880 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.505847 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:12.506535 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.506523 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:12.506609 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.506546 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:12.506609 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.506556 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:12.516779 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.516640 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.532018 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.531992 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-170.ec2.internal\" not found" node="ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.536320 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.536303 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-170.ec2.internal\" not found" node="ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.617605 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.617581 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.632937 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.632917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b34e8a23bd204528e11ac13c6b9096b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-170.ec2.internal\" (UID: \"4b34e8a23bd204528e11ac13c6b9096b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.633007 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.632942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.633007 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.632958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.718057 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.718032 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.733399 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b34e8a23bd204528e11ac13c6b9096b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-170.ec2.internal\" (UID: \"4b34e8a23bd204528e11ac13c6b9096b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.733462 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.733462 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.733462 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733444 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.733555 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733465 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b34e8a23bd204528e11ac13c6b9096b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-170.ec2.internal\" (UID: \"4b34e8a23bd204528e11ac13c6b9096b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.733555 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.733476 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbb8e3c1b874c65af6a2db19c8320789-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal\" (UID: \"fbb8e3c1b874c65af6a2db19c8320789\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.818835 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.818767 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:12.835215 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.835196 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.840314 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:12.840290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:12.918938 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:12.918905 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:13.019282 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:13.019252 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.180262 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.180240 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.228955 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.228928 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:14.280923 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.280897 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.319667 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.319647 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:14.329157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.329142 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 03:31:14.329272 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.329250 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:31:14.329331 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.329252 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:31:14.329331 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.329252 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:31:14.381951 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.381929 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.445544 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.445466 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 03:26:13 +0000 UTC" deadline="2028-04-08 05:24:11.782583533 +0000 UTC" Sep 17 03:31:14.445544 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.445503 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13657h52m57.33708444s" Sep 17 03:31:14.468472 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.468455 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:31:14.469288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.469273 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:31:14.469353 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.469301 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:31:14.469353 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.469312 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:31:14.482033 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.482013 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.582945 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.582917 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.683505 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.683479 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.689596 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.689579 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:31:14.784363 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:14.784292 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-170.ec2.internal\" not found" Sep 17 03:31:14.818269 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.818244 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:14.891445 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.891425 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" Sep 17 03:31:14.901053 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.901038 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:31:14.902080 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.902068 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" Sep 17 03:31:14.912872 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:14.912856 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:31:15.370001 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.369974 2557 apiserver.go:52] "Watching apiserver" Sep 17 03:31:15.376006 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.375971 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 03:31:15.378509 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.378482 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-m2tnp","kube-system/global-pull-secret-syncer-9fdtp","openshift-dns/node-resolver-qlxnd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal","openshift-multus/multus-t8krg","openshift-network-diagnostics/network-check-target-8gq5g","openshift-network-operator/iptables-alerter-nhkjr","openshift-ovn-kubernetes/ovnkube-node-bsbpp","kube-system/konnectivity-agent-8wssh","kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs","openshift-cluster-node-tuning-operator/tuned-vs5kd","openshift-image-registry/node-ca-4f6d7","openshift-multus/multus-additional-cni-plugins-6qldr"] Sep 17 03:31:15.380601 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.380578 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.382215 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.382190 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.382311 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.382269 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:15.382984 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.382960 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.383106 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.382964 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 03:31:15.383106 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.383038 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.383233 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.383165 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9pqzt\"" Sep 17 03:31:15.384826 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.384808 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.386717 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.386692 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.386822 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.386756 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.386948 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.386933 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-grdr5\"" Sep 17 03:31:15.387037 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.387021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.387138 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.387118 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:15.388846 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.388758 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.389990 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.389854 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 03:31:15.390751 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.390534 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:15.390751 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.390593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:15.391419 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.391261 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 03:31:15.391419 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.391311 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 03:31:15.395380 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.392325 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.395380 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.393121 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cbr4g\"" Sep 17 03:31:15.395380 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.393448 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.395380 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.393939 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.396058 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.395675 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.396158 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.396019 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 03:31:15.396158 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.396059 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mxzcm\"" Sep 17 03:31:15.396452 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.396433 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.396740 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.396718 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399012 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399174 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399186 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399425 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-869sc\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399430 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399574 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.399841 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.399638 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.401136 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.401117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.401884 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.401558 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-49s5g\"" Sep 17 03:31:15.401884 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.401649 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 03:31:15.401884 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.401745 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 03:31:15.402699 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-systemd-units\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.402838 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.402838 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.402950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.402950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-cnibin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.402950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8944b29a-f58b-4577-8194-50e6ab5b9af6-tmp-dir\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.402950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.402950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402932 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-cni-binary-copy\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-conf-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.402979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-multus-certs\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-netns\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403026 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsl4t\" (UniqueName: \"kubernetes.io/projected/70bed96e-18a3-486e-b8a7-69d23f45c26e-kube-api-access-qsl4t\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-script-lib\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwc2\" (UniqueName: \"kubernetes.io/projected/f6d264c0-7cf7-4e7e-bcbf-59817517a843-kube-api-access-bqwc2\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7bcd111-01fa-494c-8b00-b610d67336c2-serviceca\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403154 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-system-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403180 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-socket-dir-parent\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403220 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-netns\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403243 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-multus-daemon-config\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-ovn\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-node-log\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403272 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7bcd111-01fa-494c-8b00-b610d67336c2-host\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-k8s-cni-cncf-io\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403415 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7gc7m\"" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-kubelet\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-etc-kubernetes\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3614fff1-6e4f-40c7-85a8-6b50cc490509-host-slash\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-systemd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-var-lib-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.403656 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403639 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8944b29a-f58b-4577-8194-50e6ab5b9af6-hosts-file\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s554q\" (UniqueName: \"kubernetes.io/projected/8944b29a-f58b-4577-8194-50e6ab5b9af6-kube-api-access-s554q\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-bin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403796 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rx4\" (UniqueName: \"kubernetes.io/projected/470c11e5-4647-496d-9059-7024cd729d3a-kube-api-access-75rx4\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-etc-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-config\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3614fff1-6e4f-40c7-85a8-6b50cc490509-iptables-alerter-script\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.403977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-log-socket\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-netd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-env-overrides\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22mv7\" (UniqueName: \"kubernetes.io/projected/d7bcd111-01fa-494c-8b00-b610d67336c2-kube-api-access-22mv7\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-kubelet-config\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.404288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-dbus\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-multus\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkrl\" (UniqueName: \"kubernetes.io/projected/3614fff1-6e4f-40c7-85a8-6b50cc490509-kube-api-access-nzkrl\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-kubelet\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404211 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-slash\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-bin\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404255 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-hostroot\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404565 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.405119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.404653 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:31:15.406714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.406501 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.406714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.406525 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.406937 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.406909 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 03:31:15.407040 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.406960 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.407115 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.407099 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prgm2\"" Sep 17 03:31:15.409273 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.409248 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 03:31:15.409360 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.409351 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:31:15.409410 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.409257 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-76879\"" Sep 17 03:31:15.421918 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.421897 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pjhns" Sep 17 03:31:15.431702 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.431682 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pjhns" Sep 17 03:31:15.467371 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.466820 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" event={"ID":"4b34e8a23bd204528e11ac13c6b9096b","Type":"ContainerStarted","Data":"11d59c65467785d533b7d985a4bdbaab17836b61156d608201be76b98835b8de"} Sep 17 03:31:15.470179 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.470156 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" event={"ID":"fbb8e3c1b874c65af6a2db19c8320789","Type":"ContainerStarted","Data":"5c0f616f30663325a7dfa260ee4f23d493c0d605a6273e8c1f275fc0da57f59c"} Sep 17 03:31:15.492654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.492585 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 03:31:15.505202 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505178 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-hostroot\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5827c-48ca-4e4e-b55a-262dcbf19401-konnectivity-ca\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-conf-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505292 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-hostroot\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-netns\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.505326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8f5827c-48ca-4e4e-b55a-262dcbf19401-agent-certs\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-sys\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505378 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-netns\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.505386 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsl4t\" (UniqueName: \"kubernetes.io/projected/70bed96e-18a3-486e-b8a7-69d23f45c26e-kube-api-access-qsl4t\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505347 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-conf-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.505461 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:16.005440413 +0000 UTC m=+3.022561678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-multus-daemon-config\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-ovn\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505587 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505633 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-ovn\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.505654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98kw\" (UniqueName: \"kubernetes.io/projected/1da58906-5f25-4d55-af14-80fde93cb2e7-kube-api-access-w98kw\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-kubelet\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-etc-kubernetes\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3614fff1-6e4f-40c7-85a8-6b50cc490509-host-slash\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505719 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-kubelet\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-var-lib-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-script-lib\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-etc-kubernetes\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505823 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-var-lib-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-system-cni-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505837 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-bin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505894 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3614fff1-6e4f-40c7-85a8-6b50cc490509-host-slash\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75rx4\" (UniqueName: \"kubernetes.io/projected/470c11e5-4647-496d-9059-7024cd729d3a-kube-api-access-75rx4\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:15.506319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505959 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-etc-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505936 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-bin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.505984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506020 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-etc-openvswitch\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506027 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-socket-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3614fff1-6e4f-40c7-85a8-6b50cc490509-iptables-alerter-script\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-netd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22mv7\" (UniqueName: \"kubernetes.io/projected/d7bcd111-01fa-494c-8b00-b610d67336c2-kube-api-access-22mv7\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysconfig\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506193 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-kubernetes\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506200 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-netd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506204 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-multus-daemon-config\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506215 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-lib-modules\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-var-lib-kubelet\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-kubelet-config\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.507099 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-dbus\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506353 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-kubelet-config\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cnibin\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-dbus\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506425 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gtgd\" (UniqueName: \"kubernetes.io/projected/869e3934-c37e-4c58-88a0-dc42809ec383-kube-api-access-7gtgd\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-host\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506446 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-script-lib\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-systemd-units\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506524 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-systemd-units\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506561 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506574 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3614fff1-6e4f-40c7-85a8-6b50cc490509-iptables-alerter-script\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-tuned\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506594 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506608 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-cnibin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8944b29a-f58b-4577-8194-50e6ab5b9af6-tmp-dir\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.507879 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506689 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-cnibin\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-cni-binary-copy\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506790 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-multus-certs\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506835 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-multus-certs\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506863 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-device-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-sys-fs\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-run\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwc2\" (UniqueName: \"kubernetes.io/projected/f6d264c0-7cf7-4e7e-bcbf-59817517a843-kube-api-access-bqwc2\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.506984 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8944b29a-f58b-4577-8194-50e6ab5b9af6-tmp-dir\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507004 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7bcd111-01fa-494c-8b00-b610d67336c2-serviceca\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-registration-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-systemd\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-system-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-socket-dir-parent\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-netns\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-node-log\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.508603 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7bcd111-01fa-494c-8b00-b610d67336c2-host\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-k8s-cni-cncf-io\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507250 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-multus-socket-dir-parent\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507256 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-systemd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507286 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-config\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8944b29a-f58b-4577-8194-50e6ab5b9af6-hosts-file\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-netns\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507288 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-node-log\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507320 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-system-cni-dir\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s554q\" (UniqueName: \"kubernetes.io/projected/8944b29a-f58b-4577-8194-50e6ab5b9af6-kube-api-access-s554q\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507232 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/470c11e5-4647-496d-9059-7024cd729d3a-cni-binary-copy\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-env-overrides\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507387 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7bcd111-01fa-494c-8b00-b610d67336c2-host\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507414 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7bcd111-01fa-494c-8b00-b610d67336c2-serviceca\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-log-socket\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507465 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8944b29a-f58b-4577-8194-50e6ab5b9af6-hosts-file\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.509470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507290 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-run-systemd\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507469 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68jn9\" (UniqueName: \"kubernetes.io/projected/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-kube-api-access-68jn9\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507322 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-run-k8s-cni-cncf-io\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-modprobe-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.507576 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-conf\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507607 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-log-socket\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-tmp\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.507741 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:16.007633877 +0000 UTC m=+3.024755141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-multus\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507765 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovnkube-config\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkrl\" (UniqueName: \"kubernetes.io/projected/3614fff1-6e4f-40c7-85a8-6b50cc490509-kube-api-access-nzkrl\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507831 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/470c11e5-4647-496d-9059-7024cd729d3a-host-var-lib-cni-multus\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-kubelet\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-slash\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507874 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6d264c0-7cf7-4e7e-bcbf-59817517a843-env-overrides\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-bin\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.510325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507919 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.511074 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-kubelet\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.511074 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507992 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-cni-bin\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.511074 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.507997 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.511074 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.508024 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6d264c0-7cf7-4e7e-bcbf-59817517a843-host-slash\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.511074 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.510946 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d264c0-7cf7-4e7e-bcbf-59817517a843-ovn-node-metrics-cert\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.512434 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.512414 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:15.512541 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.512438 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:15.512541 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.512450 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:15.512541 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:15.512512 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:16.012494148 +0000 UTC m=+3.029615407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:15.514802 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.514725 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rx4\" (UniqueName: \"kubernetes.io/projected/470c11e5-4647-496d-9059-7024cd729d3a-kube-api-access-75rx4\") pod \"multus-t8krg\" (UID: \"470c11e5-4647-496d-9059-7024cd729d3a\") " pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.514945 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.514920 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22mv7\" (UniqueName: \"kubernetes.io/projected/d7bcd111-01fa-494c-8b00-b610d67336c2-kube-api-access-22mv7\") pod \"node-ca-4f6d7\" (UID: \"d7bcd111-01fa-494c-8b00-b610d67336c2\") " pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.515280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.515259 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsl4t\" (UniqueName: \"kubernetes.io/projected/70bed96e-18a3-486e-b8a7-69d23f45c26e-kube-api-access-qsl4t\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:15.515676 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.515659 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s554q\" (UniqueName: \"kubernetes.io/projected/8944b29a-f58b-4577-8194-50e6ab5b9af6-kube-api-access-s554q\") pod \"node-resolver-qlxnd\" (UID: \"8944b29a-f58b-4577-8194-50e6ab5b9af6\") " pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.515956 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.515937 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwc2\" (UniqueName: \"kubernetes.io/projected/f6d264c0-7cf7-4e7e-bcbf-59817517a843-kube-api-access-bqwc2\") pod \"ovnkube-node-bsbpp\" (UID: \"f6d264c0-7cf7-4e7e-bcbf-59817517a843\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.516322 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.516306 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkrl\" (UniqueName: \"kubernetes.io/projected/3614fff1-6e4f-40c7-85a8-6b50cc490509-kube-api-access-nzkrl\") pod \"iptables-alerter-nhkjr\" (UID: \"3614fff1-6e4f-40c7-85a8-6b50cc490509\") " pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.608721 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608692 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.608890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608732 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68jn9\" (UniqueName: \"kubernetes.io/projected/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-kube-api-access-68jn9\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.608890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-modprobe-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.608890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-conf\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609033 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-tmp\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609033 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608931 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5827c-48ca-4e4e-b55a-262dcbf19401-konnectivity-ca\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.609033 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.608980 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8f5827c-48ca-4e4e-b55a-262dcbf19401-agent-certs\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.609033 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609004 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-sys\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609033 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609030 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98kw\" (UniqueName: \"kubernetes.io/projected/1da58906-5f25-4d55-af14-80fde93cb2e7-kube-api-access-w98kw\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-system-cni-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-socket-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.609257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609189 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-modprobe-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609247 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-sys\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609264 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysconfig\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysconfig\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-kubernetes\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-lib-modules\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609366 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-d\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-lib-modules\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609490 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-socket-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609500 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-kubernetes\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609055 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-sysctl-conf\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609523 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.609533 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609530 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-system-cni-dir\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-var-lib-kubelet\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cnibin\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609615 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gtgd\" (UniqueName: \"kubernetes.io/projected/869e3934-c37e-4c58-88a0-dc42809ec383-kube-api-access-7gtgd\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-host\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-tuned\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609910 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5827c-48ca-4e4e-b55a-262dcbf19401-konnectivity-ca\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cnibin\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.609981 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-var-lib-kubelet\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-device-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610039 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-sys-fs\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-run\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610128 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-registration-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610155 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-systemd\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610203 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-systemd\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610243 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-run\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610266 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610291 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-device-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610311 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-registration-dir\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610334 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/869e3934-c37e-4c58-88a0-dc42809ec383-sys-fs\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610352 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1da58906-5f25-4d55-af14-80fde93cb2e7-host\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.610890 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.610431 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-cni-binary-copy\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.611409 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.611390 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-tmp\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.611796 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.611765 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1da58906-5f25-4d55-af14-80fde93cb2e7-etc-tuned\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.612044 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.612022 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8f5827c-48ca-4e4e-b55a-262dcbf19401-agent-certs\") pod \"konnectivity-agent-8wssh\" (UID: \"b8f5827c-48ca-4e4e-b55a-262dcbf19401\") " pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.617161 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.617141 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98kw\" (UniqueName: \"kubernetes.io/projected/1da58906-5f25-4d55-af14-80fde93cb2e7-kube-api-access-w98kw\") pod \"tuned-vs5kd\" (UID: \"1da58906-5f25-4d55-af14-80fde93cb2e7\") " pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:15.617407 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.617379 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68jn9\" (UniqueName: \"kubernetes.io/projected/4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be-kube-api-access-68jn9\") pod \"multus-additional-cni-plugins-6qldr\" (UID: \"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be\") " pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.617580 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.617560 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gtgd\" (UniqueName: \"kubernetes.io/projected/869e3934-c37e-4c58-88a0-dc42809ec383-kube-api-access-7gtgd\") pod \"aws-ebs-csi-driver-node-rh2qs\" (UID: \"869e3934-c37e-4c58-88a0-dc42809ec383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.694424 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.694331 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4f6d7" Sep 17 03:31:15.702193 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.702168 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:15.704241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.704220 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qlxnd" Sep 17 03:31:15.713844 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.713824 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8krg" Sep 17 03:31:15.719417 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.719245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhkjr" Sep 17 03:31:15.726717 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.726693 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:15.734288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.734269 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:15.741862 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.741839 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6qldr" Sep 17 03:31:15.748308 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.748288 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" Sep 17 03:31:15.754805 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:15.754770 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" Sep 17 03:31:16.013108 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.013009 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:16.013108 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.013077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.013115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013148 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013218 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:17.013198433 +0000 UTC m=+4.030319702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013239 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013258 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013270 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:16.013328 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013318 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:17.013303217 +0000 UTC m=+4.030424475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:16.013674 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013381 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:16.013674 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:16.013414 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:17.013402686 +0000 UTC m=+4.030523949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:16.058243 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.058211 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:16.297708 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.297662 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4fa17a_1e79_4868_b5fb_ed3a0cfbf7be.slice/crio-bc79d68626873a8b3be2d857d8394af2d7e13240fff2d2b1f8782b914c927af9 WatchSource:0}: Error finding container bc79d68626873a8b3be2d857d8394af2d7e13240fff2d2b1f8782b914c927af9: Status 404 returned error can't find the container with id bc79d68626873a8b3be2d857d8394af2d7e13240fff2d2b1f8782b914c927af9 Sep 17 03:31:16.298793 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.298757 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da58906_5f25_4d55_af14_80fde93cb2e7.slice/crio-b94e847f7a5bcb23331e510991373eae8d056844990f997e3da5ccdc3ef4c1d6 WatchSource:0}: Error finding container b94e847f7a5bcb23331e510991373eae8d056844990f997e3da5ccdc3ef4c1d6: Status 404 returned error can't find the container with id b94e847f7a5bcb23331e510991373eae8d056844990f997e3da5ccdc3ef4c1d6 Sep 17 03:31:16.300813 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.300607 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3614fff1_6e4f_40c7_85a8_6b50cc490509.slice/crio-972e5510dd7277d7428272f8bbef1110dc27b62bcbc2f1681f368502b875e61e WatchSource:0}: Error finding container 972e5510dd7277d7428272f8bbef1110dc27b62bcbc2f1681f368502b875e61e: Status 404 returned error can't find the container with id 972e5510dd7277d7428272f8bbef1110dc27b62bcbc2f1681f368502b875e61e Sep 17 03:31:16.302432 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.302411 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f5827c_48ca_4e4e_b55a_262dcbf19401.slice/crio-aa5d1ce5c32369e91ed632c2595a3c33a79af4cbfc437ab474d80ca24d346d6e WatchSource:0}: Error finding container aa5d1ce5c32369e91ed632c2595a3c33a79af4cbfc437ab474d80ca24d346d6e: Status 404 returned error can't find the container with id aa5d1ce5c32369e91ed632c2595a3c33a79af4cbfc437ab474d80ca24d346d6e Sep 17 03:31:16.303070 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.303045 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470c11e5_4647_496d_9059_7024cd729d3a.slice/crio-b75490aaf319db6b69eb01c33575aa7f219faa2c686a710db3832b7a586f27dc WatchSource:0}: Error finding container b75490aaf319db6b69eb01c33575aa7f219faa2c686a710db3832b7a586f27dc: Status 404 returned error can't find the container with id b75490aaf319db6b69eb01c33575aa7f219faa2c686a710db3832b7a586f27dc Sep 17 03:31:16.304195 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.304172 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bcd111_01fa_494c_8b00_b610d67336c2.slice/crio-6ad8684539450d2b66e96994331fd68c81ab985b422a6af53bd21e8013410597 WatchSource:0}: Error finding container 6ad8684539450d2b66e96994331fd68c81ab985b422a6af53bd21e8013410597: Status 404 returned error can't find the container with id 6ad8684539450d2b66e96994331fd68c81ab985b422a6af53bd21e8013410597 Sep 17 03:31:16.327856 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.327832 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d264c0_7cf7_4e7e_bcbf_59817517a843.slice/crio-235de13f2341a7c1fad9e4130ea6bc9f9755b6a16c1f35fb27ce225dfd0396ab WatchSource:0}: Error finding container 235de13f2341a7c1fad9e4130ea6bc9f9755b6a16c1f35fb27ce225dfd0396ab: Status 404 returned error can't find the container with id 235de13f2341a7c1fad9e4130ea6bc9f9755b6a16c1f35fb27ce225dfd0396ab Sep 17 03:31:16.328295 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.328261 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869e3934_c37e_4c58_88a0_dc42809ec383.slice/crio-ae79866a6ba5b4dc91fed11b47652b58152daf5383e6724d69b01c78b5a3f24e WatchSource:0}: Error finding container ae79866a6ba5b4dc91fed11b47652b58152daf5383e6724d69b01c78b5a3f24e: Status 404 returned error can't find the container with id ae79866a6ba5b4dc91fed11b47652b58152daf5383e6724d69b01c78b5a3f24e Sep 17 03:31:16.328808 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:16.328768 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8944b29a_f58b_4577_8194_50e6ab5b9af6.slice/crio-8981c601f6d6c2ec6d3307676aa609819c80d890ee7dad747fd943c62c7a1e7f WatchSource:0}: Error finding container 8981c601f6d6c2ec6d3307676aa609819c80d890ee7dad747fd943c62c7a1e7f: Status 404 returned error can't find the container with id 8981c601f6d6c2ec6d3307676aa609819c80d890ee7dad747fd943c62c7a1e7f Sep 17 03:31:16.435493 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.435441 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:26:15 +0000 UTC" deadline="2028-06-20 10:31:27.10518148 +0000 UTC" Sep 17 03:31:16.435493 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.435491 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15415h0m10.669692759s" Sep 17 03:31:16.473696 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.473660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlxnd" event={"ID":"8944b29a-f58b-4577-8194-50e6ab5b9af6","Type":"ContainerStarted","Data":"8981c601f6d6c2ec6d3307676aa609819c80d890ee7dad747fd943c62c7a1e7f"} Sep 17 03:31:16.475162 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.475131 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" event={"ID":"869e3934-c37e-4c58-88a0-dc42809ec383","Type":"ContainerStarted","Data":"ae79866a6ba5b4dc91fed11b47652b58152daf5383e6724d69b01c78b5a3f24e"} Sep 17 03:31:16.476513 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.476494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f6d7" event={"ID":"d7bcd111-01fa-494c-8b00-b610d67336c2","Type":"ContainerStarted","Data":"6ad8684539450d2b66e96994331fd68c81ab985b422a6af53bd21e8013410597"} Sep 17 03:31:16.477829 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.477806 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhkjr" event={"ID":"3614fff1-6e4f-40c7-85a8-6b50cc490509","Type":"ContainerStarted","Data":"972e5510dd7277d7428272f8bbef1110dc27b62bcbc2f1681f368502b875e61e"} Sep 17 03:31:16.479094 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.479074 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8krg" event={"ID":"470c11e5-4647-496d-9059-7024cd729d3a","Type":"ContainerStarted","Data":"b75490aaf319db6b69eb01c33575aa7f219faa2c686a710db3832b7a586f27dc"} Sep 17 03:31:16.480281 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.480255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" event={"ID":"1da58906-5f25-4d55-af14-80fde93cb2e7","Type":"ContainerStarted","Data":"b94e847f7a5bcb23331e510991373eae8d056844990f997e3da5ccdc3ef4c1d6"} Sep 17 03:31:16.481488 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.481461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerStarted","Data":"bc79d68626873a8b3be2d857d8394af2d7e13240fff2d2b1f8782b914c927af9"} Sep 17 03:31:16.483466 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.483440 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" event={"ID":"4b34e8a23bd204528e11ac13c6b9096b","Type":"ContainerStarted","Data":"f12a1cb66054b52a6899d9384d35f260c45b38e1ff31237486d5114d32bc3265"} Sep 17 03:31:16.484829 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.484807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"235de13f2341a7c1fad9e4130ea6bc9f9755b6a16c1f35fb27ce225dfd0396ab"} Sep 17 03:31:16.486062 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.486043 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8wssh" event={"ID":"b8f5827c-48ca-4e4e-b55a-262dcbf19401","Type":"ContainerStarted","Data":"aa5d1ce5c32369e91ed632c2595a3c33a79af4cbfc437ab474d80ca24d346d6e"} Sep 17 03:31:16.497992 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:16.497955 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-170.ec2.internal" podStartSLOduration=2.497942233 podStartE2EDuration="2.497942233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:16.497526274 +0000 UTC m=+3.514647553" watchObservedRunningTime="2026-09-17 03:31:16.497942233 +0000 UTC m=+3.515063513" Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.018905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.018964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.019005 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019201 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019267 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019281 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:19.019323314 +0000 UTC m=+6.036444613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019866 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019926 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:19.019910453 +0000 UTC m=+6.037031717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.019991 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:17.020068 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.020023 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:19.020011938 +0000 UTC m=+6.037133201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:17.046058 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.045977 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:31:17.436241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.436174 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:26:15 +0000 UTC" deadline="2028-04-26 06:30:05.642835467 +0000 UTC" Sep 17 03:31:17.436241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.436211 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14090h58m48.206629206s" Sep 17 03:31:17.465769 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.465737 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:17.465949 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.465933 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:17.466006 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.465960 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:17.467318 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.466074 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:17.467318 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.466181 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:17.468664 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:17.468592 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:17.497623 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.497046 2557 generic.go:356] "Generic (PLEG): container finished" podID="fbb8e3c1b874c65af6a2db19c8320789" containerID="4a3b76d3bb38485464f1e4498453da83e1695c11e0f19766598a27157cb33c9c" exitCode=0 Sep 17 03:31:17.497623 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:17.497513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" event={"ID":"fbb8e3c1b874c65af6a2db19c8320789","Type":"ContainerDied","Data":"4a3b76d3bb38485464f1e4498453da83e1695c11e0f19766598a27157cb33c9c"} Sep 17 03:31:18.526158 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:18.525709 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" event={"ID":"fbb8e3c1b874c65af6a2db19c8320789","Type":"ContainerStarted","Data":"7521ac05f26a3b208ca6a862801e51154ab04eacbaafecdb4722094bf9da2b93"} Sep 17 03:31:19.034384 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.034342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:19.034574 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.034403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:19.034574 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.034436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:19.034681 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.034582 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:19.034681 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.034600 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:19.034681 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.034615 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:19.034681 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.034672 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:23.034654987 +0000 UTC m=+10.051776262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:19.035113 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.035088 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:19.035190 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.035147 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:23.035130574 +0000 UTC m=+10.052251837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:19.035254 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.035206 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:19.035254 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.035238 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:23.035226906 +0000 UTC m=+10.052348181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:19.463004 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.462927 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:19.463165 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.462985 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:19.463165 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.463073 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:19.463165 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:19.463114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:19.463326 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.463241 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:19.463376 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:19.463323 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:21.461614 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:21.461581 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:21.462088 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:21.461588 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:21.462088 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:21.461718 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:21.462088 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:21.461795 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:21.462088 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:21.461588 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:21.462088 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:21.461897 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.067104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.067159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.067203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067343 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067360 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067371 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067425 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:31.067408655 +0000 UTC m=+18.084529918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067763 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067801 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067836 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:31.067820514 +0000 UTC m=+18.084941784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:23.067842 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.067852 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:31.067844144 +0000 UTC m=+18.084965405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:23.462834 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.462732 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:23.462962 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.462862 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:23.462962 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.462871 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:23.463032 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.462997 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:23.463078 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:23.463057 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:23.463148 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:23.463126 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:25.464869 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:25.464986 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:25.465030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:25.465053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:25.465106 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:25.465227 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:25.465186 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:27.464957 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:27.464909 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:27.464957 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:27.464932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:27.465516 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:27.465021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:27.465516 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:27.465040 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:27.465516 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:27.465105 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:27.465516 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:27.465171 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:29.464618 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:29.464591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:29.465100 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:29.464722 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:29.465100 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:29.464762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:29.465100 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:29.464872 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:29.465100 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:29.464897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:29.465100 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:29.464961 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:31.124235 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.124191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.124276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.124309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124363 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124376 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124388 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124402 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124404 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124443 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:47.124426487 +0000 UTC m=+34.141547762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124460 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:47.124452062 +0000 UTC m=+34.141573319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:31.124757 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.124477 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:31:47.124468065 +0000 UTC m=+34.141589324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:31.464687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.464609 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:31.464860 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.464620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:31.464860 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.464716 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:31.464860 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.464843 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:31.464997 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:31.464620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:31.464997 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:31.464959 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:33.464606 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:33.464576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:33.465053 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:33.464683 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:33.465053 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:33.464754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:33.465053 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:33.464868 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:33.465053 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:33.464906 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:33.465053 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:33.464973 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:34.562990 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.562567 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8krg" event={"ID":"470c11e5-4647-496d-9059-7024cd729d3a","Type":"ContainerStarted","Data":"fa7074ebcce3e6e96b39bce91a096cf0c1904445969ec784ca476a11d7e528c3"} Sep 17 03:31:34.564270 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.564242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" event={"ID":"1da58906-5f25-4d55-af14-80fde93cb2e7","Type":"ContainerStarted","Data":"38467ccc96a079ccb382c36af73939b0f4f3e5df2700acc7badb9d42f91f0846"} Sep 17 03:31:34.565812 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.565773 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="f87ba973ef630388b2cef337ffdbe22afc2d00bd3fa67c61f5d06794e3fa26dd" exitCode=0 Sep 17 03:31:34.565905 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.565807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"f87ba973ef630388b2cef337ffdbe22afc2d00bd3fa67c61f5d06794e3fa26dd"} Sep 17 03:31:34.568227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.568206 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"e937654a389d53ac521cd586f969e33a5853bb0fffc4f38bca08322d4fb7a44c"} Sep 17 03:31:34.568326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.568278 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"9126dfacdc432fcd5d8a7c28e8c54a3d8a1e536804e963a89b9178a832b24216"} Sep 17 03:31:34.568395 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.568333 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"269c570576ce8bda6a4017dff46602b7109580139c4cdcda94cc8efed41b93f6"} Sep 17 03:31:34.569922 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.569896 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8wssh" event={"ID":"b8f5827c-48ca-4e4e-b55a-262dcbf19401","Type":"ContainerStarted","Data":"9b636d82bc091515d672f25eed7dfe0e094e5dcabd5abd026765c9dc386b4cf0"} Sep 17 03:31:34.571444 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.571423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qlxnd" event={"ID":"8944b29a-f58b-4577-8194-50e6ab5b9af6","Type":"ContainerStarted","Data":"dd4d14929f59cae56ea67cba9a67b90b4ad483620ac1593b3b84a629f4ff5632"} Sep 17 03:31:34.573307 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.573281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" event={"ID":"869e3934-c37e-4c58-88a0-dc42809ec383","Type":"ContainerStarted","Data":"fe288a9afb26b3ed13a8812865a050768ccfa620bde256553df5e5c927090e67"} Sep 17 03:31:34.574906 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.574886 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4f6d7" event={"ID":"d7bcd111-01fa-494c-8b00-b610d67336c2","Type":"ContainerStarted","Data":"a646dca6f44a49228d2203af864bd49166d66272f96ee35990b87f259159114e"} Sep 17 03:31:34.578617 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.578575 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-170.ec2.internal" podStartSLOduration=20.578553073 podStartE2EDuration="20.578553073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:18.542429465 +0000 UTC m=+5.559550745" watchObservedRunningTime="2026-09-17 03:31:34.578553073 +0000 UTC m=+21.595674351" Sep 17 03:31:34.578709 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.578652 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t8krg" podStartSLOduration=3.7021744070000002 podStartE2EDuration="21.578646533s" totalImagesPullingTime="17.876472126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.578229977 +0000 UTC m=+21.595351253" watchObservedRunningTime="2026-09-17 03:31:34.578646533 +0000 UTC m=+21.595767812" Sep 17 03:31:34.591741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.591701 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8wssh" podStartSLOduration=7.711229251 podStartE2EDuration="21.591689079s" totalImagesPullingTime="13.880459828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.591343885 +0000 UTC m=+21.608465166" watchObservedRunningTime="2026-09-17 03:31:34.591689079 +0000 UTC m=+21.608810357" Sep 17 03:31:34.641865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.641761 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vs5kd" podStartSLOduration=3.818374393 podStartE2EDuration="21.641736554s" totalImagesPullingTime="17.823362161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.626921404 +0000 UTC m=+21.644042682" watchObservedRunningTime="2026-09-17 03:31:34.641736554 +0000 UTC m=+21.658857834" Sep 17 03:31:34.641992 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.641964 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4f6d7" podStartSLOduration=3.843257259 podStartE2EDuration="21.641943099s" totalImagesPullingTime="17.79868584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.640916921 +0000 UTC m=+21.658038213" watchObservedRunningTime="2026-09-17 03:31:34.641943099 +0000 UTC m=+21.659064378" Sep 17 03:31:34.657608 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:34.657574 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qlxnd" podStartSLOduration=3.8639909770000003 podStartE2EDuration="21.657560593s" totalImagesPullingTime="17.793569616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.657457643 +0000 UTC m=+21.674578921" watchObservedRunningTime="2026-09-17 03:31:34.657560593 +0000 UTC m=+21.674681871" Sep 17 03:31:35.461224 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.461140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:35.461406 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.461140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:35.461406 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:35.461248 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:35.461406 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.461145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:35.461406 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:35.461309 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:35.461653 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:35.461438 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:35.579511 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.579478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhkjr" event={"ID":"3614fff1-6e4f-40c7-85a8-6b50cc490509","Type":"ContainerStarted","Data":"6d5fcad917c94cee67958c1ea30bba00a6a1a9c524e99e6e4137277d20e0e6d5"} Sep 17 03:31:35.583100 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.583070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"3464b35ecb24cf96458a6d8adf62cd19ba52409211422d8630de8083bedb58de"} Sep 17 03:31:35.583245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.583151 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"6a40159671948bd1ca259ebd6e125c2122d69cc4ace2e7e118c532e4f1f41bdd"} Sep 17 03:31:35.583245 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.583201 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"326acfae8cc130b3300441e19efa7e54e36c6cc995e7eb0774edf48491de7193"} Sep 17 03:31:35.876789 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:35.876753 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 03:31:36.455276 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:36.455143 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T03:31:35.876768724Z","UUID":"e88c6524-525a-40c2-ac35-f15704ba6aa1","Handler":null,"Name":"","Endpoint":""} Sep 17 03:31:36.456541 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:36.456512 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 03:31:36.456541 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:36.456542 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 03:31:36.587189 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:36.587138 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" event={"ID":"869e3934-c37e-4c58-88a0-dc42809ec383","Type":"ContainerStarted","Data":"f7b6bb46d2ff76c5908535ed084f189004b5368be171c7f9a45e68fdb4b04342"} Sep 17 03:31:37.428028 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.427951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:37.428534 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.428511 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:37.441472 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.441430 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nhkjr" podStartSLOduration=6.604488258 podStartE2EDuration="24.441417574s" totalImagesPullingTime="17.836929316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:35.593012423 +0000 UTC m=+22.610133702" watchObservedRunningTime="2026-09-17 03:31:37.441417574 +0000 UTC m=+24.458538856" Sep 17 03:31:37.461636 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.461611 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:37.461765 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.461613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:37.461765 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.461732 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:37.461765 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:37.461731 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:37.461949 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:37.461823 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:37.461949 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:37.461904 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:37.591937 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.591894 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" event={"ID":"869e3934-c37e-4c58-88a0-dc42809ec383","Type":"ContainerStarted","Data":"b04a428f1d034a5ca919574563734ca21072abfe4bbde74b77eca6386b987d8d"} Sep 17 03:31:37.595760 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.595730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"ef2db40b68b84285ae9bdff13b3bcc4347d0942e0020929e1bbfc9c2abc15a95"} Sep 17 03:31:37.595998 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.595975 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:37.596423 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.596404 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8wssh" Sep 17 03:31:37.607887 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:37.607838 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh2qs" podStartSLOduration=4.208205195 podStartE2EDuration="24.607822737s" totalImagesPullingTime="20.399617542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:37.607682909 +0000 UTC m=+24.624804200" watchObservedRunningTime="2026-09-17 03:31:37.607822737 +0000 UTC m=+24.624944017" Sep 17 03:31:39.461402 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:39.461364 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:39.461859 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:39.461488 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:39.461859 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:39.461576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:39.461859 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:39.461682 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:39.461859 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:39.461733 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:39.461859 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:39.461841 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:40.604265 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.604199 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="6b7e0aebbb58c0cb6582a78e9a8ace51c9827a22d3b73a5b7320aa1d8ac9f38a" exitCode=0 Sep 17 03:31:40.604265 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.604249 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"6b7e0aebbb58c0cb6582a78e9a8ace51c9827a22d3b73a5b7320aa1d8ac9f38a"} Sep 17 03:31:40.608407 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.608237 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" event={"ID":"f6d264c0-7cf7-4e7e-bcbf-59817517a843","Type":"ContainerStarted","Data":"e2e6c0fd45c1ac68f1b97672a9706a7cb29c630e123154a978837938a7b74471"} Sep 17 03:31:40.608503 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.608461 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:40.623237 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.623217 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:40.647634 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:40.647596 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" podStartSLOduration=9.740745675 podStartE2EDuration="27.647583081s" totalImagesPullingTime="17.906837406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:40.646970206 +0000 UTC m=+27.664091498" watchObservedRunningTime="2026-09-17 03:31:40.647583081 +0000 UTC m=+27.664704380" Sep 17 03:31:41.461673 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.461633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:41.461947 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.461679 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:41.461947 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:41.461751 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:41.461947 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.461643 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:41.461947 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:41.461896 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:41.462173 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:41.461979 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:41.609982 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.609953 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:31:41.610514 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.610494 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:41.625039 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.625017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:41.999814 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.999718 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fdtp"] Sep 17 03:31:41.999971 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:41.999892 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:42.000037 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:41.999996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:42.004607 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.004518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2tnp"] Sep 17 03:31:42.004741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.004637 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:42.004814 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:42.004744 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:42.005201 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.005176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gq5g"] Sep 17 03:31:42.005279 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.005267 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:42.005370 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:42.005348 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:42.614321 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.614288 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="0c225a9d93522e047e25c712a08cb5ba398242a433b7c27d8f487f75e5fddaf4" exitCode=0 Sep 17 03:31:42.614748 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.614377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"0c225a9d93522e047e25c712a08cb5ba398242a433b7c27d8f487f75e5fddaf4"} Sep 17 03:31:42.614748 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:42.614479 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:31:43.135184 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:43.135153 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:31:43.464127 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:43.464067 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:43.464262 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:43.464183 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:43.464262 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:43.464233 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:43.464332 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:43.464316 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:44.461226 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:44.461139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:44.461567 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:44.461239 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:44.621295 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:44.621266 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="db56fb6796b62b1b7f2509d56fb8f188259c7d3d66fc7edbf2655889e93a6683" exitCode=0 Sep 17 03:31:44.621449 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:44.621353 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"db56fb6796b62b1b7f2509d56fb8f188259c7d3d66fc7edbf2655889e93a6683"} Sep 17 03:31:45.461808 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:45.461723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:45.462156 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:45.461842 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9fdtp" podUID="ef8221a8-307e-4789-97fe-f2a7a6eb6f84" Sep 17 03:31:45.462156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:45.461893 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:45.462156 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:45.461980 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2tnp" podUID="70bed96e-18a3-486e-b8a7-69d23f45c26e" Sep 17 03:31:46.461687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.461653 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:46.461883 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:46.461768 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gq5g" podUID="a88472e9-bc96-471e-abac-1d68eac6bdc7" Sep 17 03:31:46.827623 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.827554 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-170.ec2.internal" event="NodeReady" Sep 17 03:31:46.827851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.827669 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 03:31:46.860206 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.860173 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:31:46.863140 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.863119 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.865366 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.865344 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 03:31:46.865465 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.865377 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 03:31:46.865465 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.865397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwrvk\"" Sep 17 03:31:46.865652 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.865634 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 03:31:46.870229 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.870203 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 03:31:46.877795 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.877760 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:31:46.878148 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.878129 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x8dtl"] Sep 17 03:31:46.881418 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.881400 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k5jt4"] Sep 17 03:31:46.881551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.881537 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:46.883655 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.883637 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqcr5\"" Sep 17 03:31:46.883756 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.883640 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 03:31:46.883866 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.883849 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 03:31:46.885118 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.885100 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:46.887408 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.887124 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4zvn\"" Sep 17 03:31:46.887408 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.887274 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 03:31:46.887408 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.887316 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 03:31:46.887714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.887700 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 03:31:46.890008 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.889960 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8dtl"] Sep 17 03:31:46.892768 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.892723 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5jt4"] Sep 17 03:31:46.938379 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938523 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvc5b\" (UniqueName: \"kubernetes.io/projected/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-kube-api-access-kvc5b\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:46.938523 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938523 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938464 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938523 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-tmp-dir\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gb9m\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:46.938973 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:46.938802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-config-volume\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.039685 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.039648 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.039888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.039695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvc5b\" (UniqueName: \"kubernetes.io/projected/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-kube-api-access-kvc5b\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.039888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.039822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.039888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.039871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040019 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.039901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040019 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.039963 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:31:47.040019 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.039980 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:31:47.040131 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.040036 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:31:47.540015565 +0000 UTC m=+34.557136828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:31:47.040131 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040131 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-tmp-dir\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040236 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gb9m\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040255 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-config-volume\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.040569 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea94a604-929b-48d6-b421-9ecc1a4faf15-cert\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.040569 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xgb\" (UniqueName: \"kubernetes.io/projected/ea94a604-929b-48d6-b421-9ecc1a4faf15-kube-api-access-69xgb\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.040569 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.040354 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:31:47.040569 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.040406 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:47.540392212 +0000 UTC m=+34.557513469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:31:47.040569 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040494 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-tmp-dir\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.040858 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040829 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.040858 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040845 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-config-volume\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.040982 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.040871 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.045430 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.045406 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.045551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.045406 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.052338 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.052315 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gb9m\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.056147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.056113 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvc5b\" (UniqueName: \"kubernetes.io/projected/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-kube-api-access-kvc5b\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.056856 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.056835 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.141038 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.140954 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:47.141038 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.140997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:47.141254 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141127 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:47.141254 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141187 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:32:19.141169795 +0000 UTC m=+66.158291052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:31:47.141254 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.141209 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea94a604-929b-48d6-b421-9ecc1a4faf15-cert\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.141254 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.141237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xgb\" (UniqueName: \"kubernetes.io/projected/ea94a604-929b-48d6-b421-9ecc1a4faf15-kube-api-access-69xgb\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141265 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.141278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141288 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141301 2557 projected.go:196] Error preparing data for projected volume kube-api-access-4vndv for pod openshift-network-diagnostics/network-check-target-8gq5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141337 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv podName:a88472e9-bc96-471e-abac-1d68eac6bdc7 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:19.14132648 +0000 UTC m=+66.158447737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vndv" (UniqueName: "kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv") pod "network-check-target-8gq5g" (UID: "a88472e9-bc96-471e-abac-1d68eac6bdc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141372 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:47.141462 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.141410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret podName:ef8221a8-307e-4789-97fe-f2a7a6eb6f84 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:19.141398109 +0000 UTC m=+66.158519380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret") pod "global-pull-secret-syncer-9fdtp" (UID: "ef8221a8-307e-4789-97fe-f2a7a6eb6f84") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:31:47.143995 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.143975 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea94a604-929b-48d6-b421-9ecc1a4faf15-cert\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.151661 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.151640 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xgb\" (UniqueName: \"kubernetes.io/projected/ea94a604-929b-48d6-b421-9ecc1a4faf15-kube-api-access-69xgb\") pod \"ingress-canary-k5jt4\" (UID: \"ea94a604-929b-48d6-b421-9ecc1a4faf15\") " pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.201032 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.200991 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5jt4" Sep 17 03:31:47.461616 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.461525 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:31:47.461793 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.461534 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:31:47.464426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.464286 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:31:47.464426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.464322 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtnv8\"" Sep 17 03:31:47.465277 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.464541 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:31:47.489907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.489813 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5jt4"] Sep 17 03:31:47.494357 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:31:47.494335 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea94a604_929b_48d6_b421_9ecc1a4faf15.slice/crio-a4f52914a1ffbcbbc4d1e6da0bd13f4e9e5aa078502a0f29cede1db8341713e6 WatchSource:0}: Error finding container a4f52914a1ffbcbbc4d1e6da0bd13f4e9e5aa078502a0f29cede1db8341713e6: Status 404 returned error can't find the container with id a4f52914a1ffbcbbc4d1e6da0bd13f4e9e5aa078502a0f29cede1db8341713e6 Sep 17 03:31:47.544007 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.543974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:47.544142 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.544058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:47.544244 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.544167 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:31:47.544244 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.544235 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:48.544216774 +0000 UTC m=+35.561338050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:31:47.544372 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.544170 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:31:47.544372 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.544279 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:31:47.544372 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:47.544331 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:31:48.544314671 +0000 UTC m=+35.561435966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:31:47.628942 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:47.628903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5jt4" event={"ID":"ea94a604-929b-48d6-b421-9ecc1a4faf15","Type":"ContainerStarted","Data":"a4f52914a1ffbcbbc4d1e6da0bd13f4e9e5aa078502a0f29cede1db8341713e6"} Sep 17 03:31:48.461226 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.461198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:31:48.463753 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.463722 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2tjs\"" Sep 17 03:31:48.463753 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.463736 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:31:48.464486 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.464464 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:31:48.553822 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.553791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:48.553973 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:48.553871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:48.554020 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:48.553968 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:31:48.554020 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:48.553989 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:31:48.554020 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:48.554014 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:31:48.554127 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:48.554054 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:31:50.554034187 +0000 UTC m=+37.571155458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:31:48.554127 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:48.554073 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:50.554063517 +0000 UTC m=+37.571184777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:31:49.637612 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:49.637286 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="485ce9498cf8ad1b86d6a3237428361e03a05f8a3bd6ecfdafe868eb10b5770b" exitCode=0 Sep 17 03:31:49.637612 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:49.637383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"485ce9498cf8ad1b86d6a3237428361e03a05f8a3bd6ecfdafe868eb10b5770b"} Sep 17 03:31:50.569247 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:50.569206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:50.569468 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:50.569379 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:50.569468 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:50.569393 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:31:50.569468 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:50.569414 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:31:50.569606 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:50.569486 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:31:54.569467835 +0000 UTC m=+41.586589098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:31:50.569606 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:50.569490 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:31:50.569606 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:50.569543 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:31:54.569527454 +0000 UTC m=+41.586648713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:31:50.644414 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:50.644375 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be" containerID="c5e6f5f50bf93c37b55e12f5ee1fcafff883938b3c915aae39e5c5d2157f0d40" exitCode=0 Sep 17 03:31:50.644414 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:50.644416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerDied","Data":"c5e6f5f50bf93c37b55e12f5ee1fcafff883938b3c915aae39e5c5d2157f0d40"} Sep 17 03:31:51.651136 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:51.651099 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6qldr" event={"ID":"4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be","Type":"ContainerStarted","Data":"8f6e4158cfb4c5680b905d5b7a96f4be94597ac7a14a6d43a409d484f9271b98"} Sep 17 03:31:51.652633 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:51.652610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5jt4" event={"ID":"ea94a604-929b-48d6-b421-9ecc1a4faf15","Type":"ContainerStarted","Data":"f8e55e1e03b6503b819cd6bd5d01a434744882969175795bd795ea9e94351261"} Sep 17 03:31:51.672539 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:51.672492 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6qldr" podStartSLOduration=8.098414436 podStartE2EDuration="38.672476856s" totalImagesPullingTime="30.57406242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:51.672003044 +0000 UTC m=+38.689124354" watchObservedRunningTime="2026-09-17 03:31:51.672476856 +0000 UTC m=+38.689598137" Sep 17 03:31:51.687367 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:51.687317 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k5jt4" podStartSLOduration=1.7552281440000002 podStartE2EDuration="5.687303402s" totalImagesPullingTime="3.932075258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:51.686662234 +0000 UTC m=+38.703783514" watchObservedRunningTime="2026-09-17 03:31:51.687303402 +0000 UTC m=+38.704424681" Sep 17 03:31:54.595574 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:54.595533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:31:54.595894 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:54.595683 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:31:54.595894 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:31:54.595731 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:31:54.595894 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:54.595755 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:02.595733876 +0000 UTC m=+49.612855134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:31:54.595894 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:54.595890 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:31:54.596039 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:54.595907 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:31:54.596039 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:31:54.595962 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:02.59594569 +0000 UTC m=+49.613066973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:32:02.653327 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:02.653282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:02.653346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:02.653432 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:02.653435 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:02.653453 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:02.653492 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:18.653479472 +0000 UTC m=+65.670600729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:32:02.653761 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:02.653505 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:18.653499419 +0000 UTC m=+65.670620676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:32:14.631128 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:14.631102 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsbpp" Sep 17 03:32:16.532235 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.532199 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w"] Sep 17 03:32:16.534693 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.534677 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.537582 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.537554 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 03:32:16.537710 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.537626 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 03:32:16.538445 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.538416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wtcbj\"" Sep 17 03:32:16.538549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.538430 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:32:16.548473 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.548420 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.548473 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.548466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ncvb\" (UniqueName: \"kubernetes.io/projected/d4c41318-b688-40c6-ac92-d57a67b074e5-kube-api-access-7ncvb\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.549196 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.549173 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w"] Sep 17 03:32:16.630141 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.630108 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v"] Sep 17 03:32:16.631945 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.631929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.634437 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.634411 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:32:16.634437 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.634431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 03:32:16.634742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.634699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qj8vz\"" Sep 17 03:32:16.635225 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.635102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 03:32:16.635383 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.635362 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 03:32:16.647867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.647842 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v"] Sep 17 03:32:16.648764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.648743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.648871 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.648773 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ncvb\" (UniqueName: \"kubernetes.io/projected/d4c41318-b688-40c6-ac92-d57a67b074e5-kube-api-access-7ncvb\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.648871 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.648819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61642717-b30c-42e7-8570-64ff07d8ea5c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.648950 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:16.648902 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:32:16.648989 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.648955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61642717-b30c-42e7-8570-64ff07d8ea5c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.648989 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:16.648969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls podName:d4c41318-b688-40c6-ac92-d57a67b074e5 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:17.148948536 +0000 UTC m=+64.166069807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-rr59w" (UID: "d4c41318-b688-40c6-ac92-d57a67b074e5") : secret "samples-operator-tls" not found Sep 17 03:32:16.649086 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.649046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhn5\" (UniqueName: \"kubernetes.io/projected/61642717-b30c-42e7-8570-64ff07d8ea5c-kube-api-access-kdhn5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.667029 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.666998 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ncvb\" (UniqueName: \"kubernetes.io/projected/d4c41318-b688-40c6-ac92-d57a67b074e5-kube-api-access-7ncvb\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:16.718270 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.718240 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn"] Sep 17 03:32:16.720132 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.720117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.722284 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.722265 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 03:32:16.722417 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.722293 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 03:32:16.722417 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.722321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f4hl8\"" Sep 17 03:32:16.722417 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.722327 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 03:32:16.722560 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.722473 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:32:16.732941 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.732922 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn"] Sep 17 03:32:16.749503 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749472 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61642717-b30c-42e7-8570-64ff07d8ea5c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.749621 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhn5\" (UniqueName: \"kubernetes.io/projected/61642717-b30c-42e7-8570-64ff07d8ea5c-kube-api-access-kdhn5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.749621 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/884fb052-396e-4c3e-a975-70b115363ceb-config\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.749621 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pvw4\" (UniqueName: \"kubernetes.io/projected/884fb052-396e-4c3e-a975-70b115363ceb-kube-api-access-5pvw4\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.749743 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/884fb052-396e-4c3e-a975-70b115363ceb-serving-cert\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.749800 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.749757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61642717-b30c-42e7-8570-64ff07d8ea5c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.750242 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.750226 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61642717-b30c-42e7-8570-64ff07d8ea5c-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.751620 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.751604 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61642717-b30c-42e7-8570-64ff07d8ea5c-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.762444 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.762420 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhn5\" (UniqueName: \"kubernetes.io/projected/61642717-b30c-42e7-8570-64ff07d8ea5c-kube-api-access-kdhn5\") pod \"kube-storage-version-migrator-operator-6c8f84f897-hfr5v\" (UID: \"61642717-b30c-42e7-8570-64ff07d8ea5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:16.850357 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.850323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/884fb052-396e-4c3e-a975-70b115363ceb-serving-cert\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.850536 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.850413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/884fb052-396e-4c3e-a975-70b115363ceb-config\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.850536 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.850444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pvw4\" (UniqueName: \"kubernetes.io/projected/884fb052-396e-4c3e-a975-70b115363ceb-kube-api-access-5pvw4\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.850996 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.850977 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/884fb052-396e-4c3e-a975-70b115363ceb-config\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.852531 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.852509 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/884fb052-396e-4c3e-a975-70b115363ceb-serving-cert\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.858082 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.858063 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pvw4\" (UniqueName: \"kubernetes.io/projected/884fb052-396e-4c3e-a975-70b115363ceb-kube-api-access-5pvw4\") pod \"service-ca-operator-cf7c776b7-xfphn\" (UID: \"884fb052-396e-4c3e-a975-70b115363ceb\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:16.941688 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:16.941645 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" Sep 17 03:32:17.028893 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.028854 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" Sep 17 03:32:17.152436 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.152353 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:17.152576 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:17.152497 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:32:17.152576 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:17.152565 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls podName:d4c41318-b688-40c6-ac92-d57a67b074e5 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:18.152548666 +0000 UTC m=+65.169669923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-rr59w" (UID: "d4c41318-b688-40c6-ac92-d57a67b074e5") : secret "samples-operator-tls" not found Sep 17 03:32:17.207160 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.207132 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v"] Sep 17 03:32:17.210231 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:17.210205 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61642717_b30c_42e7_8570_64ff07d8ea5c.slice/crio-2f951b4f8c1b15f5e5c96e09627966e22bcf8241583d5c0c4274ae9421851dd4 WatchSource:0}: Error finding container 2f951b4f8c1b15f5e5c96e09627966e22bcf8241583d5c0c4274ae9421851dd4: Status 404 returned error can't find the container with id 2f951b4f8c1b15f5e5c96e09627966e22bcf8241583d5c0c4274ae9421851dd4 Sep 17 03:32:17.293146 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.293086 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn"] Sep 17 03:32:17.296845 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:17.296821 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884fb052_396e_4c3e_a975_70b115363ceb.slice/crio-7ff514a0521b89d052e5ccd06a46728ef78babdf0be24fb7de0c236a4ab0b7c8 WatchSource:0}: Error finding container 7ff514a0521b89d052e5ccd06a46728ef78babdf0be24fb7de0c236a4ab0b7c8: Status 404 returned error can't find the container with id 7ff514a0521b89d052e5ccd06a46728ef78babdf0be24fb7de0c236a4ab0b7c8 Sep 17 03:32:17.716397 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.716354 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" event={"ID":"884fb052-396e-4c3e-a975-70b115363ceb","Type":"ContainerStarted","Data":"7ff514a0521b89d052e5ccd06a46728ef78babdf0be24fb7de0c236a4ab0b7c8"} Sep 17 03:32:17.717416 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:17.717391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" event={"ID":"61642717-b30c-42e7-8570-64ff07d8ea5c","Type":"ContainerStarted","Data":"2f951b4f8c1b15f5e5c96e09627966e22bcf8241583d5c0c4274ae9421851dd4"} Sep 17 03:32:18.159090 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:18.158795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:18.159090 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.159007 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:32:18.159090 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.159070 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls podName:d4c41318-b688-40c6-ac92-d57a67b074e5 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:20.159051739 +0000 UTC m=+67.176173019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-rr59w" (UID: "d4c41318-b688-40c6-ac92-d57a67b074e5") : secret "samples-operator-tls" not found Sep 17 03:32:18.662967 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:18.662889 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:18.663144 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:18.662983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:18.663144 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.663090 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:32:18.663263 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.663170 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls podName:8acf9e51-7b5e-4237-89e4-994ba18cc4e0 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:50.663151277 +0000 UTC m=+97.680272551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls") pod "dns-default-x8dtl" (UID: "8acf9e51-7b5e-4237-89e4-994ba18cc4e0") : secret "dns-default-metrics-tls" not found Sep 17 03:32:18.663263 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.663093 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:32:18.663263 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.663194 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-678bd5bcf6-qcdws: secret "image-registry-tls" not found Sep 17 03:32:18.663263 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:18.663235 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls podName:972c0367-1165-4c07-9f27-2f7d5696c97d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:50.663223782 +0000 UTC m=+97.680345042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls") pod "image-registry-678bd5bcf6-qcdws" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d") : secret "image-registry-tls" not found Sep 17 03:32:19.165944 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.165905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:32:19.166399 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.165966 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:32:19.166399 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.166039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:32:19.168664 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.168633 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:32:19.168664 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.168648 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:32:19.168873 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.168689 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:32:19.176570 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:19.176544 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:32:19.176675 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:19.176606 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs podName:70bed96e-18a3-486e-b8a7-69d23f45c26e nodeName:}" failed. No retries permitted until 2026-09-17 03:33:23.176586405 +0000 UTC m=+130.193707666 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs") pod "network-metrics-daemon-m2tnp" (UID: "70bed96e-18a3-486e-b8a7-69d23f45c26e") : secret "metrics-daemon-secret" not found Sep 17 03:32:19.178230 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.178211 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:32:19.178819 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.178796 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8221a8-307e-4789-97fe-f2a7a6eb6f84-original-pull-secret\") pod \"global-pull-secret-syncer-9fdtp\" (UID: \"ef8221a8-307e-4789-97fe-f2a7a6eb6f84\") " pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:32:19.189677 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.189658 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vndv\" (UniqueName: \"kubernetes.io/projected/a88472e9-bc96-471e-abac-1d68eac6bdc7-kube-api-access-4vndv\") pod \"network-check-target-8gq5g\" (UID: \"a88472e9-bc96-471e-abac-1d68eac6bdc7\") " pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:32:19.282470 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.282437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9fdtp" Sep 17 03:32:19.373980 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.373948 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2tjs\"" Sep 17 03:32:19.381809 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.381763 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:32:19.810963 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.810889 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9fdtp"] Sep 17 03:32:19.811764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:19.811744 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gq5g"] Sep 17 03:32:20.175665 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.175626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:20.176149 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:20.175803 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:32:20.176149 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:20.175883 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls podName:d4c41318-b688-40c6-ac92-d57a67b074e5 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:24.175860904 +0000 UTC m=+71.192982184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-rr59w" (UID: "d4c41318-b688-40c6-ac92-d57a67b074e5") : secret "samples-operator-tls" not found Sep 17 03:32:20.344444 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:20.344409 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8221a8_307e_4789_97fe_f2a7a6eb6f84.slice/crio-b5c9da57f38be2ef9ff419a35f534e9d25db7b0920e3787e89ff1bcc0ab22c81 WatchSource:0}: Error finding container b5c9da57f38be2ef9ff419a35f534e9d25db7b0920e3787e89ff1bcc0ab22c81: Status 404 returned error can't find the container with id b5c9da57f38be2ef9ff419a35f534e9d25db7b0920e3787e89ff1bcc0ab22c81 Sep 17 03:32:20.345093 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:20.345055 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88472e9_bc96_471e_abac_1d68eac6bdc7.slice/crio-dd37d53457f98274730ad16f11c47e1604095445688d4d3fb07d4f5fbab14b8e WatchSource:0}: Error finding container dd37d53457f98274730ad16f11c47e1604095445688d4d3fb07d4f5fbab14b8e: Status 404 returned error can't find the container with id dd37d53457f98274730ad16f11c47e1604095445688d4d3fb07d4f5fbab14b8e Sep 17 03:32:20.727338 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.727255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" event={"ID":"884fb052-396e-4c3e-a975-70b115363ceb","Type":"ContainerStarted","Data":"a6ec52428f734465c96cd67797533ceeab436cde708e3986086b564db2736a24"} Sep 17 03:32:20.729257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.729202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fdtp" event={"ID":"ef8221a8-307e-4789-97fe-f2a7a6eb6f84","Type":"ContainerStarted","Data":"b5c9da57f38be2ef9ff419a35f534e9d25db7b0920e3787e89ff1bcc0ab22c81"} Sep 17 03:32:20.730530 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.730484 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gq5g" event={"ID":"a88472e9-bc96-471e-abac-1d68eac6bdc7","Type":"ContainerStarted","Data":"dd37d53457f98274730ad16f11c47e1604095445688d4d3fb07d4f5fbab14b8e"} Sep 17 03:32:20.733262 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.733229 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" event={"ID":"61642717-b30c-42e7-8570-64ff07d8ea5c","Type":"ContainerStarted","Data":"288b3008c06c4f176de5cf31cb9a022ae8ca746e6365d2cd90a086d84a6595ee"} Sep 17 03:32:20.741802 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:20.741741 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" podStartSLOduration=1.657523469 podStartE2EDuration="4.741716779s" totalImagesPullingTime="3.08419331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:20.740681225 +0000 UTC m=+67.757802505" watchObservedRunningTime="2026-09-17 03:32:20.741716779 +0000 UTC m=+67.758838051" Sep 17 03:32:21.058852 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.058114 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" podStartSLOduration=2.476572097 podStartE2EDuration="5.058087913s" totalImagesPullingTime="2.581515816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:20.755883482 +0000 UTC m=+67.773004761" watchObservedRunningTime="2026-09-17 03:32:21.058087913 +0000 UTC m=+68.075209196" Sep 17 03:32:21.058852 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.058842 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5tbsh"] Sep 17 03:32:21.061320 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.061279 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.066259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.065836 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 03:32:21.066259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.065897 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jc9x5\"" Sep 17 03:32:21.066259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.065978 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 03:32:21.066259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.066105 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 03:32:21.066259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.066120 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 03:32:21.076401 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.076321 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5tbsh"] Sep 17 03:32:21.084804 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.084705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf72418f-f5a6-40ef-b89a-5839d95f690f-data-volume\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.084804 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.084763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf72418f-f5a6-40ef-b89a-5839d95f690f-crio-socket\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.085157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.085011 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.085157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.085050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.085157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.085072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mtwb\" (UniqueName: \"kubernetes.io/projected/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-api-access-2mtwb\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186024 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.185985 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf72418f-f5a6-40ef-b89a-5839d95f690f-data-volume\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186420 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186098 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf72418f-f5a6-40ef-b89a-5839d95f690f-crio-socket\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186420 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186420 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186420 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mtwb\" (UniqueName: \"kubernetes.io/projected/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-api-access-2mtwb\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186420 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186379 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf72418f-f5a6-40ef-b89a-5839d95f690f-data-volume\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.186581 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.186536 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:21.186581 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.186559 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:32:21.186638 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.186623 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:21.686602134 +0000 UTC m=+68.703723394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : configmap "kube-rbac-proxy" not found Sep 17 03:32:21.186683 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.186641 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:21.686629751 +0000 UTC m=+68.703751024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:21.186765 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.186747 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf72418f-f5a6-40ef-b89a-5839d95f690f-crio-socket\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.197262 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.197232 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mtwb\" (UniqueName: \"kubernetes.io/projected/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-api-access-2mtwb\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.691735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:21.691796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.691888 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.691903 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.691951 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:22.691932237 +0000 UTC m=+69.709053501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : configmap "kube-rbac-proxy" not found Sep 17 03:32:21.692005 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:21.691969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:22.691960357 +0000 UTC m=+69.709081620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:22.701083 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:22.700866 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:22.701083 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:22.700908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:22.701083 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:22.701023 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:32:22.701083 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:22.701034 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:22.701732 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:22.701097 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:24.701078024 +0000 UTC m=+71.718199303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:22.701732 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:22.701116 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:24.701106875 +0000 UTC m=+71.718228135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : configmap "kube-rbac-proxy" not found Sep 17 03:32:23.210910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:23.210876 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlxnd_8944b29a-f58b-4577-8194-50e6ab5b9af6/dns-node-resolver/0.log" Sep 17 03:32:23.811480 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:23.811442 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f6d7_d7bcd111-01fa-494c-8b00-b610d67336c2/node-ca/0.log" Sep 17 03:32:24.215396 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.215305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:24.215566 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.215510 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:32:24.215630 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.215602 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls podName:d4c41318-b688-40c6-ac92-d57a67b074e5 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:32.215579757 +0000 UTC m=+79.232701021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-rr59w" (UID: "d4c41318-b688-40c6-ac92-d57a67b074e5") : secret "samples-operator-tls" not found Sep 17 03:32:24.611716 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.611686 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5jt4_ea94a604-929b-48d6-b421-9ecc1a4faf15/serve-healthcheck-canary/0.log" Sep 17 03:32:24.719977 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.719930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:24.719977 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.719982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:24.720219 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.720083 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:24.720219 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.720157 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:28.720139428 +0000 UTC m=+75.737260690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:24.720219 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.720087 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:32:24.720338 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:24.720289 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:28.720271317 +0000 UTC m=+75.737392578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : configmap "kube-rbac-proxy" not found Sep 17 03:32:24.938039 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.938013 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9cvj2"] Sep 17 03:32:24.940752 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.940730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:24.943840 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.943819 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 03:32:24.943958 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.943827 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 03:32:24.944044 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.944026 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 03:32:24.944745 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.944718 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jsbtr\"" Sep 17 03:32:24.944843 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.944791 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 03:32:24.950799 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:24.950746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9cvj2"] Sep 17 03:32:25.023410 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.023367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-key\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.023575 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.023418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-cabundle\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.023575 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.023540 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x566b\" (UniqueName: \"kubernetes.io/projected/60edd69b-39a2-4008-832c-aa9da5b1c1c1-kube-api-access-x566b\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.124791 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.124737 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x566b\" (UniqueName: \"kubernetes.io/projected/60edd69b-39a2-4008-832c-aa9da5b1c1c1-kube-api-access-x566b\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.124985 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.124898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-key\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.124985 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.124926 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-cabundle\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.125714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.125690 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-cabundle\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.127381 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.127359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60edd69b-39a2-4008-832c-aa9da5b1c1c1-signing-key\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.133382 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.133357 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x566b\" (UniqueName: \"kubernetes.io/projected/60edd69b-39a2-4008-832c-aa9da5b1c1c1-kube-api-access-x566b\") pod \"service-ca-568869fdc5-9cvj2\" (UID: \"60edd69b-39a2-4008-832c-aa9da5b1c1c1\") " pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.258466 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.258383 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" Sep 17 03:32:25.528901 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.528834 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-9cvj2"] Sep 17 03:32:25.531595 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:25.531566 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60edd69b_39a2_4008_832c_aa9da5b1c1c1.slice/crio-9fd50a02e7d7dd6cadafa1f0c3f1a06da75847e75799201f61b2004a39115dad WatchSource:0}: Error finding container 9fd50a02e7d7dd6cadafa1f0c3f1a06da75847e75799201f61b2004a39115dad: Status 404 returned error can't find the container with id 9fd50a02e7d7dd6cadafa1f0c3f1a06da75847e75799201f61b2004a39115dad Sep 17 03:32:25.749187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.749147 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" event={"ID":"60edd69b-39a2-4008-832c-aa9da5b1c1c1","Type":"ContainerStarted","Data":"2f317e7184cbd9621c6e56269c2266b247fd37fab9ff18cd02a27aafca58d760"} Sep 17 03:32:25.749373 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.749209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" event={"ID":"60edd69b-39a2-4008-832c-aa9da5b1c1c1","Type":"ContainerStarted","Data":"9fd50a02e7d7dd6cadafa1f0c3f1a06da75847e75799201f61b2004a39115dad"} Sep 17 03:32:25.750659 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.750635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9fdtp" event={"ID":"ef8221a8-307e-4789-97fe-f2a7a6eb6f84","Type":"ContainerStarted","Data":"843282e3fe53fb454cc1d98d3cc60c2a9fd18eb9126c28301b04727f0ab928f4"} Sep 17 03:32:25.752120 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.752100 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gq5g" event={"ID":"a88472e9-bc96-471e-abac-1d68eac6bdc7","Type":"ContainerStarted","Data":"674953ea79fc2801d802b3e4ad710ba5156d4539d0d18fdff167408e29d5dd79"} Sep 17 03:32:25.752246 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.752230 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:32:25.766351 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.766304 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-9cvj2" podStartSLOduration=1.766291044 podStartE2EDuration="1.766291044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:25.76552138 +0000 UTC m=+72.782642662" watchObservedRunningTime="2026-09-17 03:32:25.766291044 +0000 UTC m=+72.783412323" Sep 17 03:32:25.779632 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.779557 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9fdtp" podStartSLOduration=68.224544849 podStartE2EDuration="1m12.779546149s" totalImagesPullingTime="4.5550013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:25.778665315 +0000 UTC m=+72.795786594" watchObservedRunningTime="2026-09-17 03:32:25.779546149 +0000 UTC m=+72.796667427" Sep 17 03:32:25.795370 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:25.795329 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8gq5g" podStartSLOduration=68.243752388 podStartE2EDuration="1m12.795318493s" totalImagesPullingTime="4.551566105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:25.794373218 +0000 UTC m=+72.811494522" watchObservedRunningTime="2026-09-17 03:32:25.795318493 +0000 UTC m=+72.812439772" Sep 17 03:32:28.757365 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:28.757323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:28.757756 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:28.757382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:28.757756 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:28.757449 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:32:28.757756 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:28.757480 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:28.757756 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:28.757502 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:36.757488753 +0000 UTC m=+83.774610010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : configmap "kube-rbac-proxy" not found Sep 17 03:32:28.757756 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:28.757537 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:36.757519833 +0000 UTC m=+83.774641104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:32.289317 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:32.289279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:32.291650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:32.291620 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c41318-b688-40c6-ac92-d57a67b074e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-rr59w\" (UID: \"d4c41318-b688-40c6-ac92-d57a67b074e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:32.443156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:32.443109 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" Sep 17 03:32:32.711591 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:32.711559 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w"] Sep 17 03:32:32.774290 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:32.774243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" event={"ID":"d4c41318-b688-40c6-ac92-d57a67b074e5","Type":"ContainerStarted","Data":"7ad4e794d04a6e5e4426b73911727eef715104572e01187ba0595c8444a5c2a6"} Sep 17 03:32:34.782315 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:34.782278 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" event={"ID":"d4c41318-b688-40c6-ac92-d57a67b074e5","Type":"ContainerStarted","Data":"b2e8c0a9cfe93be0db3764c283c0e55b570cf37c7780f769bac5f6ccde74b8a0"} Sep 17 03:32:34.782695 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:34.782325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" event={"ID":"d4c41318-b688-40c6-ac92-d57a67b074e5","Type":"ContainerStarted","Data":"6d17c49af2acb31786e85b99c5be65d6bd81e0dd630ebae55b9970befdf51ef0"} Sep 17 03:32:34.798257 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:34.798208 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-rr59w" podStartSLOduration=16.960636968 podStartE2EDuration="18.798193954s" totalImagesPullingTime="1.837556986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:34.797179017 +0000 UTC m=+81.814300297" watchObservedRunningTime="2026-09-17 03:32:34.798193954 +0000 UTC m=+81.815315233" Sep 17 03:32:36.830284 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:36.830167 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:36.830284 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:36.830240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:36.830816 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:36.830392 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:32:36.830816 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:36.830473 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls podName:bf72418f-f5a6-40ef-b89a-5839d95f690f nodeName:}" failed. No retries permitted until 2026-09-17 03:32:52.830452363 +0000 UTC m=+99.847573637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5tbsh" (UID: "bf72418f-f5a6-40ef-b89a-5839d95f690f") : secret "insights-runtime-extractor-tls" not found Sep 17 03:32:36.830816 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:36.830655 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf72418f-f5a6-40ef-b89a-5839d95f690f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:46.033400 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.033368 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh"] Sep 17 03:32:46.035830 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.035813 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.041690 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.041647 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 03:32:46.042807 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.042758 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 17 03:32:46.042915 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.042757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 03:32:46.042915 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.042790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 03:32:46.044698 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.044680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wnb77\"" Sep 17 03:32:46.054136 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.054114 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh"] Sep 17 03:32:46.105833 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.105798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/eaa6a8be-cebb-448a-b577-943528abffb3-kube-api-access-clmqv\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.105968 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.105889 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa6a8be-cebb-448a-b577-943528abffb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.139429 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.139397 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-xgmbb"] Sep 17 03:32:46.141297 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.141281 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:32:46.144225 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.144204 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tf4t8\"" Sep 17 03:32:46.144325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.144248 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 03:32:46.144325 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.144250 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 03:32:46.161544 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.161515 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-xgmbb"] Sep 17 03:32:46.206602 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.206575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa6a8be-cebb-448a-b577-943528abffb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.206720 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.206682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/eaa6a8be-cebb-448a-b577-943528abffb3-kube-api-access-clmqv\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.208956 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.208928 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa6a8be-cebb-448a-b577-943528abffb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.218466 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.218446 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmqv\" (UniqueName: \"kubernetes.io/projected/eaa6a8be-cebb-448a-b577-943528abffb3-kube-api-access-clmqv\") pod \"managed-serviceaccount-addon-agent-75846b8c86-d4frh\" (UID: \"eaa6a8be-cebb-448a-b577-943528abffb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.307667 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.307593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxs4f\" (UniqueName: \"kubernetes.io/projected/dc07667a-c80d-468b-97c4-a20ffbb58b98-kube-api-access-sxs4f\") pod \"downloads-76f99584f4-xgmbb\" (UID: \"dc07667a-c80d-468b-97c4-a20ffbb58b98\") " pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:32:46.360424 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.360393 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" Sep 17 03:32:46.413306 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.413183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxs4f\" (UniqueName: \"kubernetes.io/projected/dc07667a-c80d-468b-97c4-a20ffbb58b98-kube-api-access-sxs4f\") pod \"downloads-76f99584f4-xgmbb\" (UID: \"dc07667a-c80d-468b-97c4-a20ffbb58b98\") " pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:32:46.436235 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.436172 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxs4f\" (UniqueName: \"kubernetes.io/projected/dc07667a-c80d-468b-97c4-a20ffbb58b98-kube-api-access-sxs4f\") pod \"downloads-76f99584f4-xgmbb\" (UID: \"dc07667a-c80d-468b-97c4-a20ffbb58b98\") " pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:32:46.449878 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.449854 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:32:46.633078 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.633052 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh"] Sep 17 03:32:46.636073 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:46.636050 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaa6a8be_cebb_448a_b577_943528abffb3.slice/crio-a410203a80ae7adace749c9fd17252eea2ca335d3d389b25c7c762688fcb2f3f WatchSource:0}: Error finding container a410203a80ae7adace749c9fd17252eea2ca335d3d389b25c7c762688fcb2f3f: Status 404 returned error can't find the container with id a410203a80ae7adace749c9fd17252eea2ca335d3d389b25c7c762688fcb2f3f Sep 17 03:32:46.720208 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.720180 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-xgmbb"] Sep 17 03:32:46.722673 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:46.722649 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc07667a_c80d_468b_97c4_a20ffbb58b98.slice/crio-b458a525287ae7d6f411db1f9eac0c8748842e47db360dcac12c728fe71e927b WatchSource:0}: Error finding container b458a525287ae7d6f411db1f9eac0c8748842e47db360dcac12c728fe71e927b: Status 404 returned error can't find the container with id b458a525287ae7d6f411db1f9eac0c8748842e47db360dcac12c728fe71e927b Sep 17 03:32:46.819923 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.819891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" event={"ID":"eaa6a8be-cebb-448a-b577-943528abffb3","Type":"ContainerStarted","Data":"a410203a80ae7adace749c9fd17252eea2ca335d3d389b25c7c762688fcb2f3f"} Sep 17 03:32:46.820983 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:46.820951 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-xgmbb" event={"ID":"dc07667a-c80d-468b-97c4-a20ffbb58b98","Type":"ContainerStarted","Data":"b458a525287ae7d6f411db1f9eac0c8748842e47db360dcac12c728fe71e927b"} Sep 17 03:32:49.835646 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:49.835596 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" event={"ID":"eaa6a8be-cebb-448a-b577-943528abffb3","Type":"ContainerStarted","Data":"91e6d43f646e86223e99c81052275aa6954e318a9c98eb362e17f3d49eb87f0b"} Sep 17 03:32:49.853302 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:49.853254 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75846b8c86-d4frh" podStartSLOduration=1.106769841 podStartE2EDuration="3.853238511s" totalImagesPullingTime="2.74646867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:49.852300809 +0000 UTC m=+96.869422088" watchObservedRunningTime="2026-09-17 03:32:49.853238511 +0000 UTC m=+96.870359789" Sep 17 03:32:50.749909 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.749872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:50.750091 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.749931 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:50.752568 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.752531 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8acf9e51-7b5e-4237-89e4-994ba18cc4e0-metrics-tls\") pod \"dns-default-x8dtl\" (UID: \"8acf9e51-7b5e-4237-89e4-994ba18cc4e0\") " pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:50.752680 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.752536 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"image-registry-678bd5bcf6-qcdws\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:50.776446 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.776419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwrvk\"" Sep 17 03:32:50.785264 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.785235 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:50.796251 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.796212 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqcr5\"" Sep 17 03:32:50.805091 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:50.805068 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:51.065122 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.065087 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:32:51.068528 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:51.068502 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972c0367_1165_4c07_9f27_2f7d5696c97d.slice/crio-fd09bac41da6edf343d8442a7dc4cff237254c02849688ef1a5df8bfb73e4e95 WatchSource:0}: Error finding container fd09bac41da6edf343d8442a7dc4cff237254c02849688ef1a5df8bfb73e4e95: Status 404 returned error can't find the container with id fd09bac41da6edf343d8442a7dc4cff237254c02849688ef1a5df8bfb73e4e95 Sep 17 03:32:51.090981 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.090949 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8dtl"] Sep 17 03:32:51.098097 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:51.098064 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acf9e51_7b5e_4237_89e4_994ba18cc4e0.slice/crio-5cf0d5e6e5ca9cc6463cb7a4adfea2af99e53c7790dc091fed57fddeee773021 WatchSource:0}: Error finding container 5cf0d5e6e5ca9cc6463cb7a4adfea2af99e53c7790dc091fed57fddeee773021: Status 404 returned error can't find the container with id 5cf0d5e6e5ca9cc6463cb7a4adfea2af99e53c7790dc091fed57fddeee773021 Sep 17 03:32:51.849019 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.848940 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8dtl" event={"ID":"8acf9e51-7b5e-4237-89e4-994ba18cc4e0","Type":"ContainerStarted","Data":"5cf0d5e6e5ca9cc6463cb7a4adfea2af99e53c7790dc091fed57fddeee773021"} Sep 17 03:32:51.851157 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.851114 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" event={"ID":"972c0367-1165-4c07-9f27-2f7d5696c97d","Type":"ContainerStarted","Data":"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927"} Sep 17 03:32:51.851298 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.851167 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" event={"ID":"972c0367-1165-4c07-9f27-2f7d5696c97d","Type":"ContainerStarted","Data":"fd09bac41da6edf343d8442a7dc4cff237254c02849688ef1a5df8bfb73e4e95"} Sep 17 03:32:51.851366 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.851317 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:32:51.870535 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:51.870486 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" podStartSLOduration=97.870470408 podStartE2EDuration="1m37.870470408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:51.870337323 +0000 UTC m=+98.887458604" watchObservedRunningTime="2026-09-17 03:32:51.870470408 +0000 UTC m=+98.887591686" Sep 17 03:32:52.705387 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.705349 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv"] Sep 17 03:32:52.738534 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.738473 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv"] Sep 17 03:32:52.738713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.738582 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:52.741276 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.741257 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 03:32:52.741370 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.741316 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-26cjd\"" Sep 17 03:32:52.873302 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.872720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:52.873302 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.872842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dggcv\" (UID: \"89a6e59e-9bb8-4824-b690-69ce22ebbf0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:52.876227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.876197 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf72418f-f5a6-40ef-b89a-5839d95f690f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5tbsh\" (UID: \"bf72418f-f5a6-40ef-b89a-5839d95f690f\") " pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:52.878044 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.878022 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5tbsh" Sep 17 03:32:52.974250 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:52.974165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dggcv\" (UID: \"89a6e59e-9bb8-4824-b690-69ce22ebbf0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:52.974404 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:52.974276 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 03:32:52.974404 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:32:52.974334 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates podName:89a6e59e-9bb8-4824-b690-69ce22ebbf0a nodeName:}" failed. No retries permitted until 2026-09-17 03:32:53.474312946 +0000 UTC m=+100.491434209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-dggcv" (UID: "89a6e59e-9bb8-4824-b690-69ce22ebbf0a") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 03:32:53.478452 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.478420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dggcv\" (UID: \"89a6e59e-9bb8-4824-b690-69ce22ebbf0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:53.481140 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.481096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/89a6e59e-9bb8-4824-b690-69ce22ebbf0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dggcv\" (UID: \"89a6e59e-9bb8-4824-b690-69ce22ebbf0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:53.483261 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.483219 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5tbsh"] Sep 17 03:32:53.551769 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:53.551685 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf72418f_f5a6_40ef_b89a_5839d95f690f.slice/crio-a9ea2e1b7964188f4849fd5df694d103a805b2778500e2b68cca6ec50a7ff9a0 WatchSource:0}: Error finding container a9ea2e1b7964188f4849fd5df694d103a805b2778500e2b68cca6ec50a7ff9a0: Status 404 returned error can't find the container with id a9ea2e1b7964188f4849fd5df694d103a805b2778500e2b68cca6ec50a7ff9a0 Sep 17 03:32:53.651572 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.651543 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:53.860590 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.860244 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tbsh" event={"ID":"bf72418f-f5a6-40ef-b89a-5839d95f690f","Type":"ContainerStarted","Data":"6388ca7841a3b736e2611484ffa80d961737886a6c647963b8e55f1979f73a38"} Sep 17 03:32:53.860590 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.860359 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tbsh" event={"ID":"bf72418f-f5a6-40ef-b89a-5839d95f690f","Type":"ContainerStarted","Data":"a9ea2e1b7964188f4849fd5df694d103a805b2778500e2b68cca6ec50a7ff9a0"} Sep 17 03:32:53.861956 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.861926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8dtl" event={"ID":"8acf9e51-7b5e-4237-89e4-994ba18cc4e0","Type":"ContainerStarted","Data":"faa8753ff7cdfdca8a92ef1414f6c5aa3a91d17fa4154ee3c7b5442b6535f7c7"} Sep 17 03:32:53.945306 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:53.944943 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv"] Sep 17 03:32:53.948272 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:32:53.948241 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a6e59e_9bb8_4824_b690_69ce22ebbf0a.slice/crio-b560e8aea8ed13abf46ce9f4893ec8cc79a72d3b0db726a1e4b30814c75a5652 WatchSource:0}: Error finding container b560e8aea8ed13abf46ce9f4893ec8cc79a72d3b0db726a1e4b30814c75a5652: Status 404 returned error can't find the container with id b560e8aea8ed13abf46ce9f4893ec8cc79a72d3b0db726a1e4b30814c75a5652 Sep 17 03:32:54.868793 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:54.868747 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tbsh" event={"ID":"bf72418f-f5a6-40ef-b89a-5839d95f690f","Type":"ContainerStarted","Data":"f575e441292b3ba278d0ce17055f36fb9cd92a98f532f6489bdf53b1dc34c916"} Sep 17 03:32:54.870657 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:54.870629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" event={"ID":"89a6e59e-9bb8-4824-b690-69ce22ebbf0a","Type":"ContainerStarted","Data":"b560e8aea8ed13abf46ce9f4893ec8cc79a72d3b0db726a1e4b30814c75a5652"} Sep 17 03:32:54.873317 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:54.873292 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8dtl" event={"ID":"8acf9e51-7b5e-4237-89e4-994ba18cc4e0","Type":"ContainerStarted","Data":"6ac6b23e40d45997807a3d36eb61719b0e9d6cc26a1b640a469d4ae6c37f8480"} Sep 17 03:32:54.873501 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:54.873485 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x8dtl" Sep 17 03:32:54.893233 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:54.893025 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x8dtl" podStartSLOduration=66.414690724 podStartE2EDuration="1m8.893010191s" totalImagesPullingTime="2.478319467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:54.892910135 +0000 UTC m=+101.910031542" watchObservedRunningTime="2026-09-17 03:32:54.893010191 +0000 UTC m=+101.910131470" Sep 17 03:32:56.758091 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:56.758057 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8gq5g" Sep 17 03:32:56.883389 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:56.883354 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" event={"ID":"89a6e59e-9bb8-4824-b690-69ce22ebbf0a","Type":"ContainerStarted","Data":"e7eeac31ae778d322bbcdb2481ac431187c18c3c6430c34e3b34c1ea5bbcc52f"} Sep 17 03:32:56.883556 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:56.883514 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:56.888910 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:56.888890 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" Sep 17 03:32:56.898449 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:56.898401 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dggcv" podStartSLOduration=3.078923209 podStartE2EDuration="4.898387142s" totalImagesPullingTime="1.819463933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:56.897895205 +0000 UTC m=+103.915016485" watchObservedRunningTime="2026-09-17 03:32:56.898387142 +0000 UTC m=+103.915508420" Sep 17 03:32:58.884396 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.884361 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:32:58.886583 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.886565 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:58.888909 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.888886 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 03:32:58.889024 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.888887 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 03:32:58.889765 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.889742 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 03:32:58.889912 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.889792 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bxd5n\"" Sep 17 03:32:58.889912 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.889819 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 03:32:58.889912 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.889828 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 03:32:58.896817 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:58.896794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:32:59.026551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.026727 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.026727 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026648 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xczw\" (UniqueName: \"kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.026727 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.026978 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.026978 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.026849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.127874 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.127827 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.127874 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.127880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xczw\" (UniqueName: \"kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128113 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.127915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128113 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.127934 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128113 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.127971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128113 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.128063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128632 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.128602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128792 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.128756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.128950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.128924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.130696 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.130676 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.130811 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.130710 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.136259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.136199 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xczw\" (UniqueName: \"kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw\") pod \"console-6d46646874-f2fj7\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:32:59.198007 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:32:59.197961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:33:02.868925 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.868893 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:02.871142 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.871115 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.880343 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.879811 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 03:33:02.906443 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.906410 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:02.960567 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skgqt\" (UniqueName: \"kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960567 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960706 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:02.960881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:02.960874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.061963 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.061918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.061975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skgqt\" (UniqueName: \"kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062357 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062357 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.062896 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.062828 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.063049 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.063024 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.063117 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.063097 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.063553 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.063507 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.065029 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.065008 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.065160 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.065136 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.083110 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.083084 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skgqt\" (UniqueName: \"kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt\") pod \"console-588b8c865d-mtvp2\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.183383 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.183299 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:03.187386 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.187361 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg"] Sep 17 03:33:03.190020 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.189993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.192827 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.192805 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 03:33:03.193344 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.192928 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 03:33:03.193344 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.193175 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 03:33:03.193344 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.193200 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 03:33:03.193547 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.193457 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 03:33:03.193638 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.193622 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5gb7m\"" Sep 17 03:33:03.208291 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.208268 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hlm6s"] Sep 17 03:33:03.214761 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.214740 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg"] Sep 17 03:33:03.214907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.214889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.225307 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.225236 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 03:33:03.226145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.225832 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 03:33:03.226145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.225981 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wgnfs\"" Sep 17 03:33:03.226145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.226070 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264025 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-wtmp\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43abaf0-c48f-48e3-b19f-e8215720f5ad-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264149 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cmvj\" (UniqueName: \"kubernetes.io/projected/3aa444b4-605f-4ccf-9d39-43982c48d5ea-kube-api-access-4cmvj\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.264426 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.264214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-metrics-client-ca\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.265653 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265477 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.265653 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-root\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.265653 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln45r\" (UniqueName: \"kubernetes.io/projected/d43abaf0-c48f-48e3-b19f-e8215720f5ad-kube-api-access-ln45r\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.265653 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.265907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-textfile\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.265907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-tls\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.265907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.265732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-sys\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367077 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-wtmp\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367249 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43abaf0-c48f-48e3-b19f-e8215720f5ad-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.367249 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367249 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cmvj\" (UniqueName: \"kubernetes.io/projected/3aa444b4-605f-4ccf-9d39-43982c48d5ea-kube-api-access-4cmvj\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367249 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367210 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-metrics-client-ca\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367249 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367259 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-wtmp\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-root\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln45r\" (UniqueName: \"kubernetes.io/projected/d43abaf0-c48f-48e3-b19f-e8215720f5ad-kube-api-access-ln45r\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367333 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-root\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-textfile\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367453 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-tls\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367666 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367466 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-sys\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.367666 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.368187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.368187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.367928 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d43abaf0-c48f-48e3-b19f-e8215720f5ad-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.368187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.368027 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa444b4-605f-4ccf-9d39-43982c48d5ea-sys\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.368187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.368105 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-textfile\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.368549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.368526 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa444b4-605f-4ccf-9d39-43982c48d5ea-metrics-client-ca\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.371092 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.371049 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-tls\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.371386 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.371341 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.371822 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.371801 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa444b4-605f-4ccf-9d39-43982c48d5ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.373002 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.372960 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d43abaf0-c48f-48e3-b19f-e8215720f5ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.380800 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.380728 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln45r\" (UniqueName: \"kubernetes.io/projected/d43abaf0-c48f-48e3-b19f-e8215720f5ad-kube-api-access-ln45r\") pod \"openshift-state-metrics-67dcf8c979-pz5hg\" (UID: \"d43abaf0-c48f-48e3-b19f-e8215720f5ad\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.382004 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.381981 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cmvj\" (UniqueName: \"kubernetes.io/projected/3aa444b4-605f-4ccf-9d39-43982c48d5ea-kube-api-access-4cmvj\") pod \"node-exporter-hlm6s\" (UID: \"3aa444b4-605f-4ccf-9d39-43982c48d5ea\") " pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.502599 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.502503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" Sep 17 03:33:03.529285 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.529252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hlm6s" Sep 17 03:33:03.831845 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:03.831812 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa444b4_605f_4ccf_9d39_43982c48d5ea.slice/crio-4e5b98dc7bddca6f8a6cf5cb66c6116129061ff4139641b36a1b84949ff3e759 WatchSource:0}: Error finding container 4e5b98dc7bddca6f8a6cf5cb66c6116129061ff4139641b36a1b84949ff3e759: Status 404 returned error can't find the container with id 4e5b98dc7bddca6f8a6cf5cb66c6116129061ff4139641b36a1b84949ff3e759 Sep 17 03:33:03.922498 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:03.920634 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlm6s" event={"ID":"3aa444b4-605f-4ccf-9d39-43982c48d5ea","Type":"ContainerStarted","Data":"4e5b98dc7bddca6f8a6cf5cb66c6116129061ff4139641b36a1b84949ff3e759"} Sep 17 03:33:04.109148 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.109019 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:04.112333 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:04.112300 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda514078_03af_4852_b61f_a0485b6e4b0a.slice/crio-3757f423ae3dc41cd70aee2b439b18fbe1e0f34b67dd2de39c85c50f1e8c4f4a WatchSource:0}: Error finding container 3757f423ae3dc41cd70aee2b439b18fbe1e0f34b67dd2de39c85c50f1e8c4f4a: Status 404 returned error can't find the container with id 3757f423ae3dc41cd70aee2b439b18fbe1e0f34b67dd2de39c85c50f1e8c4f4a Sep 17 03:33:04.154318 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.154224 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg"] Sep 17 03:33:04.161882 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.158759 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:33:04.163838 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:04.162820 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43abaf0_c48f_48e3_b19f_e8215720f5ad.slice/crio-7e7f582d180d6f2793de54766d9f3e34b1f7a6fb7807c2bc5330bdb38f282284 WatchSource:0}: Error finding container 7e7f582d180d6f2793de54766d9f3e34b1f7a6fb7807c2bc5330bdb38f282284: Status 404 returned error can't find the container with id 7e7f582d180d6f2793de54766d9f3e34b1f7a6fb7807c2bc5330bdb38f282284 Sep 17 03:33:04.164454 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:04.163996 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b25c5ce_9d5b_42d1_8d45_4e26134d978a.slice/crio-3d5c4551ead8dac47e6c2611b416dcc0400489401a96d90f7092f8ed857666a1 WatchSource:0}: Error finding container 3d5c4551ead8dac47e6c2611b416dcc0400489401a96d90f7092f8ed857666a1: Status 404 returned error can't find the container with id 3d5c4551ead8dac47e6c2611b416dcc0400489401a96d90f7092f8ed857666a1 Sep 17 03:33:04.881714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.881070 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x8dtl" Sep 17 03:33:04.928284 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.928189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b8c865d-mtvp2" event={"ID":"da514078-03af-4852-b61f-a0485b6e4b0a","Type":"ContainerStarted","Data":"3757f423ae3dc41cd70aee2b439b18fbe1e0f34b67dd2de39c85c50f1e8c4f4a"} Sep 17 03:33:04.940549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.939475 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5tbsh" event={"ID":"bf72418f-f5a6-40ef-b89a-5839d95f690f","Type":"ContainerStarted","Data":"4c40a92af86fc74df17099f07bef8c30f90f6086eebe7c754a505ef23c96ec81"} Sep 17 03:33:04.942156 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.942075 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46646874-f2fj7" event={"ID":"6b25c5ce-9d5b-42d1-8d45-4e26134d978a","Type":"ContainerStarted","Data":"3d5c4551ead8dac47e6c2611b416dcc0400489401a96d90f7092f8ed857666a1"} Sep 17 03:33:04.944467 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.944194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-xgmbb" event={"ID":"dc07667a-c80d-468b-97c4-a20ffbb58b98","Type":"ContainerStarted","Data":"fa5201849fd4a0ec3f74bdbf055dc029c05fd92789b0fea9ef48056614860624"} Sep 17 03:33:04.946350 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.944994 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:33:04.949393 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.949371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" event={"ID":"d43abaf0-c48f-48e3-b19f-e8215720f5ad","Type":"ContainerStarted","Data":"0f50e3d1d279df3aa800ff1d633e740560d77ed871c9164c6993a9f4fb8a069e"} Sep 17 03:33:04.949511 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.949471 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" event={"ID":"d43abaf0-c48f-48e3-b19f-e8215720f5ad","Type":"ContainerStarted","Data":"1fc9195ee39797cfa114b019fb969fcc048bc408943feb84d5d62379c9e40471"} Sep 17 03:33:04.949572 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.949513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" event={"ID":"d43abaf0-c48f-48e3-b19f-e8215720f5ad","Type":"ContainerStarted","Data":"7e7f582d180d6f2793de54766d9f3e34b1f7a6fb7807c2bc5330bdb38f282284"} Sep 17 03:33:04.959160 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.958767 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-xgmbb" Sep 17 03:33:04.959160 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.959050 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5tbsh" podStartSLOduration=33.963003388 podStartE2EDuration="43.959033217s" totalImagesPullingTime="9.996029829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:04.958972268 +0000 UTC m=+111.976093550" watchObservedRunningTime="2026-09-17 03:33:04.959033217 +0000 UTC m=+111.976154497" Sep 17 03:33:04.988241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:04.988184 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-xgmbb" podStartSLOduration=1.807959482 podStartE2EDuration="18.988163899s" totalImagesPullingTime="17.180204417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:04.986894495 +0000 UTC m=+112.004015774" watchObservedRunningTime="2026-09-17 03:33:04.988163899 +0000 UTC m=+112.005285180" Sep 17 03:33:05.960872 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:05.960687 2557 generic.go:356] "Generic (PLEG): container finished" podID="3aa444b4-605f-4ccf-9d39-43982c48d5ea" containerID="102ce050d98349cae576803ae8595c462dca9f4e4baaf406634f4b4e4812a6c9" exitCode=0 Sep 17 03:33:05.960872 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:05.960822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlm6s" event={"ID":"3aa444b4-605f-4ccf-9d39-43982c48d5ea","Type":"ContainerDied","Data":"102ce050d98349cae576803ae8595c462dca9f4e4baaf406634f4b4e4812a6c9"} Sep 17 03:33:06.973331 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:06.973197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlm6s" event={"ID":"3aa444b4-605f-4ccf-9d39-43982c48d5ea","Type":"ContainerStarted","Data":"b28f04863302e68ae58d323e45cb51949053ac8f2a3465275ac1ac5da1fd4ec1"} Sep 17 03:33:06.973331 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:06.973250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlm6s" event={"ID":"3aa444b4-605f-4ccf-9d39-43982c48d5ea","Type":"ContainerStarted","Data":"ac0f1a14b37f9a7a8f5449a377e50182347b28a4f941e4d8bf4c968c06c30ad7"} Sep 17 03:33:06.991888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:06.991835 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hlm6s" podStartSLOduration=2.39498622 podStartE2EDuration="3.991812456s" totalImagesPullingTime="1.503068765s" totalInitContainerRuntime="93.757471ms" isStatefulPod=true podCreationTimestamp="2026-09-17 03:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:06.991574353 +0000 UTC m=+114.008695635" watchObservedRunningTime="2026-09-17 03:33:06.991812456 +0000 UTC m=+114.008933734" Sep 17 03:33:07.965945 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:07.965820 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:33:07.982914 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:07.982599 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" event={"ID":"d43abaf0-c48f-48e3-b19f-e8215720f5ad","Type":"ContainerStarted","Data":"7b5375a21755c0d9783f42138bc911904f2f259699e3a2504423657362addc7f"} Sep 17 03:33:08.007445 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:08.007184 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-pz5hg" podStartSLOduration=2.439606093 podStartE2EDuration="5.00716143s" totalImagesPullingTime="2.567555337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:08.005946881 +0000 UTC m=+115.023068162" watchObservedRunningTime="2026-09-17 03:33:08.00716143 +0000 UTC m=+115.024282704" Sep 17 03:33:08.128435 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:08.128401 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:33:08.134214 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:08.134186 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:33:09.528718 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.528681 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:09.549185 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.549119 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.551542 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.551514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:09.551997 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.551979 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:33:09.552126 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.551979 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:33:09.552197 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.552178 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.552834 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.552942 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.552965 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553050 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553235 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ohd07g0m9ksl\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553312 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553357 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553402 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553419 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553505 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:33:09.553687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.553592 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 03:33:09.554379 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.554336 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4xh5t\"" Sep 17 03:33:09.556367 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.556339 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:33:09.559569 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.559547 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:33:09.629104 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629229 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629280 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629333 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629459 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629578 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629687 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629981 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629706 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629981 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.629981 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.629819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkwzh\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.730967 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.730933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.730999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731118 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731145 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731144 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwzh\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731958 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731958 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731958 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.731958 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731656 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.732467 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.732442 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.732610 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.732584 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.732712 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.731656 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.732926 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.732903 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.733207 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.733181 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.737524 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.737483 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.737763 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.737619 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.738037 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.737959 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.739319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.738488 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.739319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.738556 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.739319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.739177 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.739319 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.739227 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.739563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.739445 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.740251 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.739849 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.740251 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.740157 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.742050 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.740484 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.745855 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.745832 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.747811 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.747381 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwzh\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.747811 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.747497 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.863301 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.863265 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:09.991682 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.991635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46646874-f2fj7" event={"ID":"6b25c5ce-9d5b-42d1-8d45-4e26134d978a","Type":"ContainerStarted","Data":"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc"} Sep 17 03:33:09.994576 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:09.994527 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b8c865d-mtvp2" event={"ID":"da514078-03af-4852-b61f-a0485b6e4b0a","Type":"ContainerStarted","Data":"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc"} Sep 17 03:33:10.026715 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:10.026667 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-588b8c865d-mtvp2" podStartSLOduration=3.1535512199999998 podStartE2EDuration="8.026650768s" totalImagesPullingTime="4.873099548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:10.02545283 +0000 UTC m=+117.042574106" watchObservedRunningTime="2026-09-17 03:33:10.026650768 +0000 UTC m=+117.043772049" Sep 17 03:33:10.027256 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:10.027225 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d46646874-f2fj7" podStartSLOduration=7.198581706 podStartE2EDuration="12.027216596s" totalImagesPullingTime="4.82863489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:10.009638127 +0000 UTC m=+117.026759419" watchObservedRunningTime="2026-09-17 03:33:10.027216596 +0000 UTC m=+117.044337875" Sep 17 03:33:10.184741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:10.184690 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:10.187155 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:10.187125 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae3d082_3cde_4349_acc9_b82a3316a1c1.slice/crio-808a9ef15306c9189f7cfa1c127f05beba3b32381b71ea147b9c9b0c837047c1 WatchSource:0}: Error finding container 808a9ef15306c9189f7cfa1c127f05beba3b32381b71ea147b9c9b0c837047c1: Status 404 returned error can't find the container with id 808a9ef15306c9189f7cfa1c127f05beba3b32381b71ea147b9c9b0c837047c1 Sep 17 03:33:11.000652 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:11.000609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"808a9ef15306c9189f7cfa1c127f05beba3b32381b71ea147b9c9b0c837047c1"} Sep 17 03:33:12.006622 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:12.006583 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" exitCode=0 Sep 17 03:33:12.007024 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:12.006649 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} Sep 17 03:33:13.184271 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:13.184235 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:13.184716 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:13.184325 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:13.189704 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:13.189683 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:13.410523 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:13.410492 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:14.017815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:14.017769 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:16.024121 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:16.024037 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} Sep 17 03:33:16.024121 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:16.024103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} Sep 17 03:33:19.038475 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.038442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} Sep 17 03:33:19.038851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.038529 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} Sep 17 03:33:19.038851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.038554 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} Sep 17 03:33:19.038851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.038594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerStarted","Data":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} Sep 17 03:33:19.074789 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.074740 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.820913382 podStartE2EDuration="10.074725595s" totalImagesPullingTime="7.230558945s" totalInitContainerRuntime="23.253268ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:19.073017168 +0000 UTC m=+126.090138458" watchObservedRunningTime="2026-09-17 03:33:19.074725595 +0000 UTC m=+126.091846905" Sep 17 03:33:19.199080 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.199046 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:33:19.863672 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:19.863633 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:23.259907 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:23.259869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:33:23.262259 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:23.262236 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70bed96e-18a3-486e-b8a7-69d23f45c26e-metrics-certs\") pod \"network-metrics-daemon-m2tnp\" (UID: \"70bed96e-18a3-486e-b8a7-69d23f45c26e\") " pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:33:23.479031 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:23.479004 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtnv8\"" Sep 17 03:33:23.487002 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:23.486980 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2tnp" Sep 17 03:33:23.789549 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:23.789526 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2tnp"] Sep 17 03:33:23.791891 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:33:23.791859 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bed96e_18a3_486e_b8a7_69d23f45c26e.slice/crio-541c7f8ba2c6353d28efbc6e94f1bb46b52e82314a2cb625ef96d36233fa9821 WatchSource:0}: Error finding container 541c7f8ba2c6353d28efbc6e94f1bb46b52e82314a2cb625ef96d36233fa9821: Status 404 returned error can't find the container with id 541c7f8ba2c6353d28efbc6e94f1bb46b52e82314a2cb625ef96d36233fa9821 Sep 17 03:33:24.060320 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:24.060281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2tnp" event={"ID":"70bed96e-18a3-486e-b8a7-69d23f45c26e","Type":"ContainerStarted","Data":"541c7f8ba2c6353d28efbc6e94f1bb46b52e82314a2cb625ef96d36233fa9821"} Sep 17 03:33:26.069154 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:26.069123 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2tnp" event={"ID":"70bed96e-18a3-486e-b8a7-69d23f45c26e","Type":"ContainerStarted","Data":"73262bfeed3a822de11f3eca947e287153d90ea2260ead667d692479e3c3283a"} Sep 17 03:33:26.069504 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:26.069176 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2tnp" event={"ID":"70bed96e-18a3-486e-b8a7-69d23f45c26e","Type":"ContainerStarted","Data":"ebfc02bbc597cd36e2ee598e93855b62d2a1cdde9f3c73d51284e5a550457243"} Sep 17 03:33:26.086091 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:26.086048 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m2tnp" podStartSLOduration=131.529879165 podStartE2EDuration="2m13.08603393s" totalImagesPullingTime="1.556154765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:26.085336362 +0000 UTC m=+133.102457642" watchObservedRunningTime="2026-09-17 03:33:26.08603393 +0000 UTC m=+133.103155209" Sep 17 03:33:31.089125 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:31.089090 2557 generic.go:356] "Generic (PLEG): container finished" podID="884fb052-396e-4c3e-a975-70b115363ceb" containerID="a6ec52428f734465c96cd67797533ceeab436cde708e3986086b564db2736a24" exitCode=0 Sep 17 03:33:31.089497 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:31.089152 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" event={"ID":"884fb052-396e-4c3e-a975-70b115363ceb","Type":"ContainerDied","Data":"a6ec52428f734465c96cd67797533ceeab436cde708e3986086b564db2736a24"} Sep 17 03:33:31.089497 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:31.089478 2557 scope.go:117] "RemoveContainer" containerID="a6ec52428f734465c96cd67797533ceeab436cde708e3986086b564db2736a24" Sep 17 03:33:31.486370 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:31.486340 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5jt4_ea94a604-929b-48d6-b421-9ecc1a4faf15/serve-healthcheck-canary/0.log" Sep 17 03:33:32.094463 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:32.094429 2557 generic.go:356] "Generic (PLEG): container finished" podID="61642717-b30c-42e7-8570-64ff07d8ea5c" containerID="288b3008c06c4f176de5cf31cb9a022ae8ca746e6365d2cd90a086d84a6595ee" exitCode=0 Sep 17 03:33:32.094863 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:32.094507 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" event={"ID":"61642717-b30c-42e7-8570-64ff07d8ea5c","Type":"ContainerDied","Data":"288b3008c06c4f176de5cf31cb9a022ae8ca746e6365d2cd90a086d84a6595ee"} Sep 17 03:33:32.094863 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:32.094858 2557 scope.go:117] "RemoveContainer" containerID="288b3008c06c4f176de5cf31cb9a022ae8ca746e6365d2cd90a086d84a6595ee" Sep 17 03:33:32.096490 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:32.096470 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xfphn" event={"ID":"884fb052-396e-4c3e-a975-70b115363ceb","Type":"ContainerStarted","Data":"8ce0fb52d18ae022e2d8654113a248e9976aee65eb0f7cd9613254e5f4f3e55a"} Sep 17 03:33:33.102098 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.102063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-hfr5v" event={"ID":"61642717-b30c-42e7-8570-64ff07d8ea5c","Type":"ContainerStarted","Data":"e17337d88fc6cee7f497fe708fe5e9dce04ea6d7f08883b087e07c284a4e37f3"} Sep 17 03:33:33.154534 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.154488 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" podUID="972c0367-1165-4c07-9f27-2f7d5696c97d" containerName="registry" containerID="cri-o://ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927" gracePeriod=30 Sep 17 03:33:33.391000 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.390973 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:33:33.552563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552530 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552566 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552749 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552595 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552749 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552617 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552749 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552723 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552927 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552756 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gb9m\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552927 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552808 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.552927 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.552852 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token\") pod \"972c0367-1165-4c07-9f27-2f7d5696c97d\" (UID: \"972c0367-1165-4c07-9f27-2f7d5696c97d\") " Sep 17 03:33:33.553069 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.553037 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:33.553152 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.553131 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:33.553425 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.553407 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-certificates\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.555381 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.555350 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:33.555476 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.555411 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:33:33.555476 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.555434 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:33:33.555672 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.555639 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:33.555672 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.555664 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m" (OuterVolumeSpecName: "kube-api-access-6gb9m") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "kube-api-access-6gb9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:33:33.561188 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.561161 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "972c0367-1165-4c07-9f27-2f7d5696c97d" (UID: "972c0367-1165-4c07-9f27-2f7d5696c97d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654501 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-registry-tls\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654527 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-image-registry-private-configuration\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654537 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/972c0367-1165-4c07-9f27-2f7d5696c97d-trusted-ca\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654547 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/972c0367-1165-4c07-9f27-2f7d5696c97d-installation-pull-secrets\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654556 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gb9m\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-kube-api-access-6gb9m\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654564 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/972c0367-1165-4c07-9f27-2f7d5696c97d-ca-trust-extracted\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:33.654563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:33.654572 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/972c0367-1165-4c07-9f27-2f7d5696c97d-bound-sa-token\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:34.109607 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.109573 2557 generic.go:356] "Generic (PLEG): container finished" podID="972c0367-1165-4c07-9f27-2f7d5696c97d" containerID="ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927" exitCode=0 Sep 17 03:33:34.110120 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.109626 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" Sep 17 03:33:34.110120 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.109627 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" event={"ID":"972c0367-1165-4c07-9f27-2f7d5696c97d","Type":"ContainerDied","Data":"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927"} Sep 17 03:33:34.110120 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.109750 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678bd5bcf6-qcdws" event={"ID":"972c0367-1165-4c07-9f27-2f7d5696c97d","Type":"ContainerDied","Data":"fd09bac41da6edf343d8442a7dc4cff237254c02849688ef1a5df8bfb73e4e95"} Sep 17 03:33:34.110120 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.109795 2557 scope.go:117] "RemoveContainer" containerID="ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927" Sep 17 03:33:34.118241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.118226 2557 scope.go:117] "RemoveContainer" containerID="ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927" Sep 17 03:33:34.118516 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:33:34.118496 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927\": container with ID starting with ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927 not found: ID does not exist" containerID="ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927" Sep 17 03:33:34.118562 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.118523 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927"} err="failed to get container status \"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927\": rpc error: code = NotFound desc = could not find container \"ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927\": container with ID starting with ca60072c3bbf74b392a618da1b637c367bbfe0948f8c4f0d803d72c7e13ac927 not found: ID does not exist" Sep 17 03:33:34.130254 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.130233 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:33:34.137876 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:34.137856 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-678bd5bcf6-qcdws"] Sep 17 03:33:35.015326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.015285 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d46646874-f2fj7" podUID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" containerName="console" containerID="cri-o://2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc" gracePeriod=15 Sep 17 03:33:35.258899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.258874 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:33:35.365119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365094 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xczw\" (UniqueName: \"kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365127 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365147 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365288 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365249 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365314 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365426 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config\") pod \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\" (UID: \"6b25c5ce-9d5b-42d1-8d45-4e26134d978a\") " Sep 17 03:33:35.365702 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365678 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca" (OuterVolumeSpecName: "service-ca") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:35.365843 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365699 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:35.365843 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.365734 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config" (OuterVolumeSpecName: "console-config") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:35.367377 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.367357 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:35.367680 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.367657 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw" (OuterVolumeSpecName: "kube-api-access-4xczw") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "kube-api-access-4xczw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:33:35.367759 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.367737 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6b25c5ce-9d5b-42d1-8d45-4e26134d978a" (UID: "6b25c5ce-9d5b-42d1-8d45-4e26134d978a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:35.466730 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.466695 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972c0367-1165-4c07-9f27-2f7d5696c97d" path="/var/lib/kubelet/pods/972c0367-1165-4c07-9f27-2f7d5696c97d/volumes" Sep 17 03:33:35.466950 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.466931 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-oauth-serving-cert\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:35.466993 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.466953 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-service-ca\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:35.466993 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.466962 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:35.467089 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.467028 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xczw\" (UniqueName: \"kubernetes.io/projected/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-kube-api-access-4xczw\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:35.467089 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.467038 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-serving-cert\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:35.467089 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:35.467046 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b25c5ce-9d5b-42d1-8d45-4e26134d978a-console-oauth-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:36.119748 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.119714 2557 generic.go:356] "Generic (PLEG): container finished" podID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" containerID="2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc" exitCode=0 Sep 17 03:33:36.119939 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.119759 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d46646874-f2fj7" Sep 17 03:33:36.119939 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.119805 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46646874-f2fj7" event={"ID":"6b25c5ce-9d5b-42d1-8d45-4e26134d978a","Type":"ContainerDied","Data":"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc"} Sep 17 03:33:36.119939 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.119847 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d46646874-f2fj7" event={"ID":"6b25c5ce-9d5b-42d1-8d45-4e26134d978a","Type":"ContainerDied","Data":"3d5c4551ead8dac47e6c2611b416dcc0400489401a96d90f7092f8ed857666a1"} Sep 17 03:33:36.119939 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.119865 2557 scope.go:117] "RemoveContainer" containerID="2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc" Sep 17 03:33:36.131190 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.131173 2557 scope.go:117] "RemoveContainer" containerID="2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc" Sep 17 03:33:36.131460 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:33:36.131442 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc\": container with ID starting with 2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc not found: ID does not exist" containerID="2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc" Sep 17 03:33:36.131501 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.131469 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc"} err="failed to get container status \"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc\": rpc error: code = NotFound desc = could not find container \"2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc\": container with ID starting with 2ab4175794405f2b72685a64fd32dd63fd379bd7214a80457cc2112147b209bc not found: ID does not exist" Sep 17 03:33:36.141038 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.141012 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:33:36.154663 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:36.154639 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d46646874-f2fj7"] Sep 17 03:33:37.466327 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:37.466291 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" path="/var/lib/kubelet/pods/6b25c5ce-9d5b-42d1-8d45-4e26134d978a/volumes" Sep 17 03:33:40.038607 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.038564 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-588b8c865d-mtvp2" podUID="da514078-03af-4852-b61f-a0485b6e4b0a" containerName="console" containerID="cri-o://a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc" gracePeriod=15 Sep 17 03:33:40.312275 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.312246 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:40.404449 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404422 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skgqt\" (UniqueName: \"kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404457 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404480 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404507 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404551 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404589 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.404872 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.404616 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config\") pod \"da514078-03af-4852-b61f-a0485b6e4b0a\" (UID: \"da514078-03af-4852-b61f-a0485b6e4b0a\") " Sep 17 03:33:40.405056 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.405028 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca" (OuterVolumeSpecName: "service-ca") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:40.405186 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.405060 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config" (OuterVolumeSpecName: "console-config") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:40.405186 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.405148 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:40.405186 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.405170 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:33:40.406663 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.406637 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt" (OuterVolumeSpecName: "kube-api-access-skgqt") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "kube-api-access-skgqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:33:40.406756 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.406702 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:40.406963 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.406946 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da514078-03af-4852-b61f-a0485b6e4b0a" (UID: "da514078-03af-4852-b61f-a0485b6e4b0a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:33:40.505551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505519 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skgqt\" (UniqueName: \"kubernetes.io/projected/da514078-03af-4852-b61f-a0485b6e4b0a-kube-api-access-skgqt\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505544 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-service-ca\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505554 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-console-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505563 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-trusted-ca-bundle\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505573 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da514078-03af-4852-b61f-a0485b6e4b0a-oauth-serving-cert\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505581 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-serving-cert\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:40.505764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:40.505589 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da514078-03af-4852-b61f-a0485b6e4b0a-console-oauth-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:33:41.142025 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.141986 2557 generic.go:356] "Generic (PLEG): container finished" podID="da514078-03af-4852-b61f-a0485b6e4b0a" containerID="a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc" exitCode=0 Sep 17 03:33:41.142434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.142038 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588b8c865d-mtvp2" Sep 17 03:33:41.142434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.142072 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b8c865d-mtvp2" event={"ID":"da514078-03af-4852-b61f-a0485b6e4b0a","Type":"ContainerDied","Data":"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc"} Sep 17 03:33:41.142434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.142126 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588b8c865d-mtvp2" event={"ID":"da514078-03af-4852-b61f-a0485b6e4b0a","Type":"ContainerDied","Data":"3757f423ae3dc41cd70aee2b439b18fbe1e0f34b67dd2de39c85c50f1e8c4f4a"} Sep 17 03:33:41.142434 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.142151 2557 scope.go:117] "RemoveContainer" containerID="a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc" Sep 17 03:33:41.154000 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.153986 2557 scope.go:117] "RemoveContainer" containerID="a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc" Sep 17 03:33:41.154289 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:33:41.154270 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc\": container with ID starting with a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc not found: ID does not exist" containerID="a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc" Sep 17 03:33:41.154364 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.154296 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc"} err="failed to get container status \"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc\": rpc error: code = NotFound desc = could not find container \"a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc\": container with ID starting with a5f9f51b5df2ec1c92add9930ec7fa46d38bafcdcf04c33ad054bb585ab96dcc not found: ID does not exist" Sep 17 03:33:41.161532 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.161510 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:41.166547 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.165978 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-588b8c865d-mtvp2"] Sep 17 03:33:41.466669 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:33:41.466592 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da514078-03af-4852-b61f-a0485b6e4b0a" path="/var/lib/kubelet/pods/da514078-03af-4852-b61f-a0485b6e4b0a/volumes" Sep 17 03:34:09.864189 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:09.864098 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:09.883824 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:09.883791 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:10.270966 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:10.270893 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:27.921243 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921201 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:27.921742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921605 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="prometheus" containerID="cri-o://bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" gracePeriod=600 Sep 17 03:34:27.921742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921638 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="config-reloader" containerID="cri-o://d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" gracePeriod=600 Sep 17 03:34:27.921742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921621 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-web" containerID="cri-o://24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" gracePeriod=600 Sep 17 03:34:27.921742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921707 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" gracePeriod=600 Sep 17 03:34:27.921742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921608 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="thanos-sidecar" containerID="cri-o://cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" gracePeriod=600 Sep 17 03:34:27.922027 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:27.921760 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy" containerID="cri-o://909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" gracePeriod=600 Sep 17 03:34:28.153595 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.153572 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.262802 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262646 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.262802 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262771 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262816 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262836 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262853 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262895 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262926 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262955 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262963 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.262980 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263022 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263009 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263042 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263084 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263128 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263151 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263175 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263199 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkwzh\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263228 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263265 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263276 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263292 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263320 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config\") pod \"cae3d082-3cde-4349-acc9-b82a3316a1c1\" (UID: \"cae3d082-3cde-4349-acc9-b82a3316a1c1\") " Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263370 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.263479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263473 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.264176 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263654 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-metrics-client-ca\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.264176 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263674 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.264176 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263691 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.264176 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.263705 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.264845 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.264815 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.265590 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.265357 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.265992 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.265902 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:34:28.265992 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.265955 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.265992 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.265963 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.266198 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266150 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:28.266433 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266400 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.266601 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266568 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.266601 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266579 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config" (OuterVolumeSpecName: "config") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.266899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266869 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.266899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.266891 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:34:28.267820 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.267800 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out" (OuterVolumeSpecName: "config-out") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:34:28.268098 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.268078 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.268441 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.268424 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh" (OuterVolumeSpecName: "kube-api-access-qkwzh") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "kube-api-access-qkwzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:34:28.268483 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.268435 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.277266 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.277246 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config" (OuterVolumeSpecName: "web-config") pod "cae3d082-3cde-4349-acc9-b82a3316a1c1" (UID: "cae3d082-3cde-4349-acc9-b82a3316a1c1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:28.332454 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332427 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" exitCode=0 Sep 17 03:34:28.332454 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332449 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" exitCode=0 Sep 17 03:34:28.332454 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332456 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" exitCode=0 Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332463 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" exitCode=0 Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332469 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" exitCode=0 Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332473 2557 generic.go:356] "Generic (PLEG): container finished" podID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" exitCode=0 Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332511 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332569 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332621 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} Sep 17 03:34:28.332647 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} Sep 17 03:34:28.332954 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332666 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} Sep 17 03:34:28.332954 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332688 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cae3d082-3cde-4349-acc9-b82a3316a1c1","Type":"ContainerDied","Data":"808a9ef15306c9189f7cfa1c127f05beba3b32381b71ea147b9c9b0c837047c1"} Sep 17 03:34:28.332954 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.332640 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.340560 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.340454 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.347742 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.347725 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.354102 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.354086 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.357859 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.357837 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:28.361606 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.361586 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.364178 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364154 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-db\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364182 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364199 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364214 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkwzh\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-kube-api-access-qkwzh\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364227 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364240 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364254 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364269 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364287 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364282 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cae3d082-3cde-4349-acc9-b82a3316a1c1-tls-assets\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364294 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-grpc-tls\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364307 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-metrics-client-certs\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364318 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364330 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cae3d082-3cde-4349-acc9-b82a3316a1c1-config-out\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364361 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-web-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364373 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cae3d082-3cde-4349-acc9-b82a3316a1c1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.364713 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.364384 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cae3d082-3cde-4349-acc9-b82a3316a1c1-secret-kube-rbac-proxy\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:34:28.365506 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.365488 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:28.368518 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.368499 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.375581 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.375563 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.381865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.381850 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.382126 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.382107 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.382187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382145 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.382187 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382171 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.382450 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.382426 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.382495 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382455 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.382495 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382471 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.382692 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.382675 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.382741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382696 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.382741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382710 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.382992 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.382965 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.383075 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.382997 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.383075 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383012 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.383262 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.383242 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.383321 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383266 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.383321 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383284 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.383571 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.383545 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.383648 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383576 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.383648 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383591 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.383855 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:34:28.383839 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.383932 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383862 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.383932 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.383881 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.384128 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384112 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.384200 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384130 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.384364 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384342 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.384364 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384362 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.384601 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384582 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.384644 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384604 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.384882 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384865 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.384939 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.384883 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.385123 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385105 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.385167 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385123 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.385367 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385351 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.385425 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385367 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.385596 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385579 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.385636 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385596 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.385865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385846 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.385865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.385862 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.386085 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386068 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.386085 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386083 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.386309 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386288 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.386358 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386310 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.386522 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386497 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.386563 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386522 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.386766 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386750 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.386822 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386767 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.386975 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386960 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.387032 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.386975 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.387166 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387151 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.387208 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387166 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.387347 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387333 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.387385 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387347 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.387572 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387556 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.387619 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387572 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.387754 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387737 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.387881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.387753 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.388016 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388001 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.388057 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388018 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.388223 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388209 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.388263 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388224 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.388443 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388428 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.388443 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388442 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.388632 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388617 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.388678 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388632 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.388881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388864 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.388881 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.388880 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.389068 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389052 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.389111 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389068 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.389278 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389260 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.389278 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389277 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.389465 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389450 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.389505 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389464 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.389644 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389629 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.389684 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389643 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.389908 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389890 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.389961 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.389909 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.390151 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390135 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.390151 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390151 2557 scope.go:117] "RemoveContainer" containerID="9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940" Sep 17 03:34:28.390372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390354 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940"} err="failed to get container status \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": rpc error: code = NotFound desc = could not find container \"9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940\": container with ID starting with 9d446201891e4b334df6f455866659d635368b4261054ad490eca41d70d63940 not found: ID does not exist" Sep 17 03:34:28.390423 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390372 2557 scope.go:117] "RemoveContainer" containerID="909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1" Sep 17 03:34:28.390826 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390800 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1"} err="failed to get container status \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": rpc error: code = NotFound desc = could not find container \"909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1\": container with ID starting with 909fa3b41e24b60faf10bb0e0cde4b1b407ecd81eaa600a19bf5c4a2e6a4b0e1 not found: ID does not exist" Sep 17 03:34:28.390945 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.390827 2557 scope.go:117] "RemoveContainer" containerID="24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85" Sep 17 03:34:28.391270 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391245 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85"} err="failed to get container status \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": rpc error: code = NotFound desc = could not find container \"24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85\": container with ID starting with 24ae87bb592baa6abb234f8d6fe2dd3665706d2b43ac58ae98cbd17371f20e85 not found: ID does not exist" Sep 17 03:34:28.391270 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391269 2557 scope.go:117] "RemoveContainer" containerID="cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e" Sep 17 03:34:28.391560 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391535 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e"} err="failed to get container status \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": rpc error: code = NotFound desc = could not find container \"cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e\": container with ID starting with cf4d83b34dd145e33b878da6082bdde2df16203ce62fb37b0f90017a61143f1e not found: ID does not exist" Sep 17 03:34:28.391560 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391555 2557 scope.go:117] "RemoveContainer" containerID="d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682" Sep 17 03:34:28.391824 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391763 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682"} err="failed to get container status \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": rpc error: code = NotFound desc = could not find container \"d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682\": container with ID starting with d2675e162bd59733b283bff711b7706a230a1a60e4ef1a003f6e4cd099cb8682 not found: ID does not exist" Sep 17 03:34:28.391885 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.391825 2557 scope.go:117] "RemoveContainer" containerID="bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361" Sep 17 03:34:28.392057 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392040 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361"} err="failed to get container status \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": rpc error: code = NotFound desc = could not find container \"bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361\": container with ID starting with bae61a1cba72a11997f1edde418444260e9126d66832ce5e2b88afcca4614361 not found: ID does not exist" Sep 17 03:34:28.392096 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392057 2557 scope.go:117] "RemoveContainer" containerID="0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639" Sep 17 03:34:28.392286 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392269 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:28.392342 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392287 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639"} err="failed to get container status \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": rpc error: code = NotFound desc = could not find container \"0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639\": container with ID starting with 0b8ee61ca5487f83fe459cf0d394a4dc17234cc54caff17328608dbdd9cc1639 not found: ID does not exist" Sep 17 03:34:28.392512 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392500 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-thanos" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392513 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-thanos" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392523 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" containerName="console" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392529 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" containerName="console" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392535 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="config-reloader" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392541 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="config-reloader" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392547 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-web" Sep 17 03:34:28.392551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392552 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-web" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392558 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da514078-03af-4852-b61f-a0485b6e4b0a" containerName="console" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392563 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="da514078-03af-4852-b61f-a0485b6e4b0a" containerName="console" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392570 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="972c0367-1165-4c07-9f27-2f7d5696c97d" containerName="registry" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392575 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="972c0367-1165-4c07-9f27-2f7d5696c97d" containerName="registry" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392581 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="prometheus" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392586 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="prometheus" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392596 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="init-config-reloader" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392602 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="init-config-reloader" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392607 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="thanos-sidecar" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392611 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="thanos-sidecar" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392618 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392622 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392663 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392671 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="thanos-sidecar" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392676 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b25c5ce-9d5b-42d1-8d45-4e26134d978a" containerName="console" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392682 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="da514078-03af-4852-b61f-a0485b6e4b0a" containerName="console" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392687 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="prometheus" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392692 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-thanos" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392697 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="kube-rbac-proxy-web" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392702 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="972c0367-1165-4c07-9f27-2f7d5696c97d" containerName="registry" Sep 17 03:34:28.392867 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.392707 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" containerName="config-reloader" Sep 17 03:34:28.396229 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.396214 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.398734 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.398708 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:34:28.398844 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.398708 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:34:28.398844 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.398709 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 03:34:28.398844 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.398709 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4xh5t\"" Sep 17 03:34:28.398844 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.398838 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:34:28.399174 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.399156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:34:28.399236 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.399162 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:34:28.399851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.399836 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:34:28.400103 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400013 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6ohd07g0m9ksl\"" Sep 17 03:34:28.400103 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400039 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:34:28.400103 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400044 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:34:28.400455 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400438 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:34:28.400587 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400573 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:34:28.400760 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400742 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:34:28.400915 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.400874 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:34:28.402461 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.402443 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:34:28.405517 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.405497 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:34:28.411530 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.411510 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:28.465338 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465304 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465396 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465499 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465517 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jpc5\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-kube-api-access-5jpc5\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465739 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465847 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.465888 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.465885 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566789 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566893 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566816 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566893 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566962 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566962 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jpc5\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-kube-api-access-5jpc5\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.566962 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.566972 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567030 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567190 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567326 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567659 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567659 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.567659 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.567576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.569731 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.568433 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.569731 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.568475 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.569731 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.569208 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.569731 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.569375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.570200 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.570147 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.570362 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.570387 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.570857 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.570882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.571168 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571372 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.571327 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571722 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.571407 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/358f2d26-85dc-4793-84b5-d0c22c785a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571722 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.571715 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-config\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.571848 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.571730 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.572323 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.572300 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.572631 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.572611 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.572946 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.572927 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/358f2d26-85dc-4793-84b5-d0c22c785a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.573482 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.573461 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/358f2d26-85dc-4793-84b5-d0c22c785a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.574226 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.574207 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jpc5\" (UniqueName: \"kubernetes.io/projected/358f2d26-85dc-4793-84b5-d0c22c785a7c-kube-api-access-5jpc5\") pod \"prometheus-k8s-0\" (UID: \"358f2d26-85dc-4793-84b5-d0c22c785a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.708482 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.708456 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:28.989147 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:28.989084 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:34:28.991581 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:34:28.991554 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358f2d26_85dc_4793_84b5_d0c22c785a7c.slice/crio-fa85644f8e89b6ea1cce9f745ee59ec3df0dbb5c69a196338396d7ab57f37b60 WatchSource:0}: Error finding container fa85644f8e89b6ea1cce9f745ee59ec3df0dbb5c69a196338396d7ab57f37b60: Status 404 returned error can't find the container with id fa85644f8e89b6ea1cce9f745ee59ec3df0dbb5c69a196338396d7ab57f37b60 Sep 17 03:34:29.337599 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:29.337572 2557 generic.go:356] "Generic (PLEG): container finished" podID="358f2d26-85dc-4793-84b5-d0c22c785a7c" containerID="97107dfcfc6c6d1a8f0503137078a249dfd707206c7f72eb851dc95cf048f403" exitCode=0 Sep 17 03:34:29.337752 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:29.337673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerDied","Data":"97107dfcfc6c6d1a8f0503137078a249dfd707206c7f72eb851dc95cf048f403"} Sep 17 03:34:29.337853 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:29.337773 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"fa85644f8e89b6ea1cce9f745ee59ec3df0dbb5c69a196338396d7ab57f37b60"} Sep 17 03:34:29.468851 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:29.468760 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cae3d082-3cde-4349-acc9-b82a3316a1c1" path="/var/lib/kubelet/pods/cae3d082-3cde-4349-acc9-b82a3316a1c1/volumes" Sep 17 03:34:30.345937 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.345895 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"5e018cd2330927d6def630920c5b8ea8fdd43599abd7d408452a8766ac1831bf"} Sep 17 03:34:30.346296 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.346020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"0c3cf81fe86be60f2a8798831c084b495d62392e27283312c214b1892849ec89"} Sep 17 03:34:30.346296 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.346064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"dd0f936a401621724ce521a24293692cf040144907ec8b3b4e204d652aa3461f"} Sep 17 03:34:30.346296 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.346108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"e06e183c3c30f077905d345ae671eff98d0913435284207c0f52d91d18e4a2cf"} Sep 17 03:34:30.346296 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.346145 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"d789582399026787753c1b09a0311d508d72f0ce7ccbbcf9776a77c5f4941707"} Sep 17 03:34:30.346296 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.346176 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"358f2d26-85dc-4793-84b5-d0c22c785a7c","Type":"ContainerStarted","Data":"6472d6aa7e51f9a9f3171671ed22ebdb4bf01375cc86afdc2cdf4b8586a28e2b"} Sep 17 03:34:30.373711 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:30.373666 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.35540738 podStartE2EDuration="2.373653536s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.246156ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:34:30.372611319 +0000 UTC m=+197.389732598" watchObservedRunningTime="2026-09-17 03:34:30.373653536 +0000 UTC m=+197.390774814" Sep 17 03:34:33.709488 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:34:33.709455 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:28.709506 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:35:28.709472 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:28.724981 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:35:28.724953 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:29.578654 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:35:29.578625 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:36:06.393674 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.393640 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r8fw"] Sep 17 03:36:06.396568 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.396552 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.399020 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.398997 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kjxj7\"" Sep 17 03:36:06.399139 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.399030 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 03:36:06.399650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.399637 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 03:36:06.406912 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.406878 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r8fw"] Sep 17 03:36:06.475759 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.475727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.475921 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.475767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whshx\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-kube-api-access-whshx\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.576154 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.576118 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whshx\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-kube-api-access-whshx\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.576299 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.576184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.583943 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.583917 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.583943 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.583931 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whshx\" (UniqueName: \"kubernetes.io/projected/2562e45c-875b-4269-af35-7338bae5958e-kube-api-access-whshx\") pod \"cert-manager-55b4d954d5-4r8fw\" (UID: \"2562e45c-875b-4269-af35-7338bae5958e\") " pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.704897 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.704820 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4r8fw" Sep 17 03:36:06.974537 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:06.974452 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r8fw"] Sep 17 03:36:06.977545 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:36:06.977514 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2562e45c_875b_4269_af35_7338bae5958e.slice/crio-7f3f83d117796b0b7b1986227faf5381990351580c23806c3798de12255f0e3f WatchSource:0}: Error finding container 7f3f83d117796b0b7b1986227faf5381990351580c23806c3798de12255f0e3f: Status 404 returned error can't find the container with id 7f3f83d117796b0b7b1986227faf5381990351580c23806c3798de12255f0e3f Sep 17 03:36:07.699392 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:07.699355 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4r8fw" event={"ID":"2562e45c-875b-4269-af35-7338bae5958e","Type":"ContainerStarted","Data":"7f3f83d117796b0b7b1986227faf5381990351580c23806c3798de12255f0e3f"} Sep 17 03:36:10.712474 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:10.712389 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4r8fw" event={"ID":"2562e45c-875b-4269-af35-7338bae5958e","Type":"ContainerStarted","Data":"9f25b832385607764179c8a4ed8fe3b59722d6be2d5a708683add347283975e3"} Sep 17 03:36:10.728569 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:10.728523 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4r8fw" podStartSLOduration=1.387493276 podStartE2EDuration="4.728509892s" totalImagesPullingTime="3.341016616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:36:10.727252851 +0000 UTC m=+297.744374130" watchObservedRunningTime="2026-09-17 03:36:10.728509892 +0000 UTC m=+297.745631167" Sep 17 03:36:13.411038 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:36:13.411001 2557 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 03:37:28.542270 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.542194 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf"] Sep 17 03:37:28.545181 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.545164 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.547770 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.547746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-metrics-tls\"" Sep 17 03:37:28.547916 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.547752 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Sep 17 03:37:28.548512 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.548494 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Sep 17 03:37:28.548573 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.548532 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-482th\"" Sep 17 03:37:28.554335 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.554316 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf"] Sep 17 03:37:28.678997 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.678960 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-tmp\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.678997 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.679001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-manifests-work\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.679196 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.679032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45379414-666f-4abc-88a9-5b2fdac3586b-metrics-certs\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.679196 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.679139 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnj5\" (UniqueName: \"kubernetes.io/projected/45379414-666f-4abc-88a9-5b2fdac3586b-kube-api-access-fxnj5\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780497 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780459 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-tmp\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780497 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-manifests-work\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780711 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45379414-666f-4abc-88a9-5b2fdac3586b-metrics-certs\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780711 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780586 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnj5\" (UniqueName: \"kubernetes.io/projected/45379414-666f-4abc-88a9-5b2fdac3586b-kube-api-access-fxnj5\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780930 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780910 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-tmp\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.780990 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.780944 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/45379414-666f-4abc-88a9-5b2fdac3586b-manifests-work\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.782946 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.782925 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45379414-666f-4abc-88a9-5b2fdac3586b-metrics-certs\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.789119 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.789098 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnj5\" (UniqueName: \"kubernetes.io/projected/45379414-666f-4abc-88a9-5b2fdac3586b-kube-api-access-fxnj5\") pod \"trainer-operator-controller-manager-5b47b8ff84-qp6pf\" (UID: \"45379414-666f-4abc-88a9-5b2fdac3586b\") " pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:28.856294 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:28.856252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:29.126882 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:29.126857 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf"] Sep 17 03:37:29.129395 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:37:29.129367 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45379414_666f_4abc_88a9_5b2fdac3586b.slice/crio-8d92b7cf5ad4a0ba4a0e02dd4058c222ae0c6a9b50372a1b3e249d86eb263851 WatchSource:0}: Error finding container 8d92b7cf5ad4a0ba4a0e02dd4058c222ae0c6a9b50372a1b3e249d86eb263851: Status 404 returned error can't find the container with id 8d92b7cf5ad4a0ba4a0e02dd4058c222ae0c6a9b50372a1b3e249d86eb263851 Sep 17 03:37:29.131241 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:29.131221 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:37:30.001278 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:30.001200 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" event={"ID":"45379414-666f-4abc-88a9-5b2fdac3586b","Type":"ContainerStarted","Data":"8d92b7cf5ad4a0ba4a0e02dd4058c222ae0c6a9b50372a1b3e249d86eb263851"} Sep 17 03:37:32.011564 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:32.011473 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" event={"ID":"45379414-666f-4abc-88a9-5b2fdac3586b","Type":"ContainerStarted","Data":"c68eb1d492fff922fc1cf7a994dff45876bb38c4b96e20d9155f68accc929d09"} Sep 17 03:37:32.012040 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:32.011609 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:37:32.028808 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:32.028727 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" podStartSLOduration=1.598797563 podStartE2EDuration="4.028712631s" totalImagesPullingTime="2.429915068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:37:32.026981578 +0000 UTC m=+379.044102901" watchObservedRunningTime="2026-09-17 03:37:32.028712631 +0000 UTC m=+379.045833909" Sep 17 03:37:43.018036 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:37:43.018002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-5b47b8ff84-qp6pf" Sep 17 03:38:18.358556 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.358522 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:38:18.361476 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.361458 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.364071 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.364037 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 03:38:18.364181 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.364069 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 03:38:18.364181 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.364097 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 03:38:18.364181 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.364069 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 03:38:18.364922 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.364904 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-7c47z\"" Sep 17 03:38:18.375966 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.375944 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:38:18.464712 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.464679 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.464876 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.464720 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.464876 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.464743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dv9x\" (UniqueName: \"kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.566092 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.566056 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.566275 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.566107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.566275 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.566133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dv9x\" (UniqueName: \"kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.566815 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.566753 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.568623 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.568602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.575062 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.575038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dv9x\" (UniqueName: \"kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x\") pod \"kubeflow-trainer-controller-manager-7f9b886978-8vcd8\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.670638 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.670557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:18.941741 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:18.941711 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:38:18.943772 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:38:18.943744 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3889988_9e0e_4857_9a95_e9bfc15d6f12.slice/crio-2925d8b4650d56a366d9f7686df89c9acc7cb7323e5d9b9dd74f6de6fd479129 WatchSource:0}: Error finding container 2925d8b4650d56a366d9f7686df89c9acc7cb7323e5d9b9dd74f6de6fd479129: Status 404 returned error can't find the container with id 2925d8b4650d56a366d9f7686df89c9acc7cb7323e5d9b9dd74f6de6fd479129 Sep 17 03:38:19.183255 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:19.183222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" event={"ID":"d3889988-9e0e-4857-9a95-e9bfc15d6f12","Type":"ContainerStarted","Data":"2925d8b4650d56a366d9f7686df89c9acc7cb7323e5d9b9dd74f6de6fd479129"} Sep 17 03:38:22.197144 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:22.197108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" event={"ID":"d3889988-9e0e-4857-9a95-e9bfc15d6f12","Type":"ContainerStarted","Data":"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2"} Sep 17 03:38:22.197513 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:22.197169 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:38:22.215029 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:22.214985 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" podStartSLOduration=1.838813623 podStartE2EDuration="4.214971254s" totalImagesPullingTime="2.376157631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:38:22.214130854 +0000 UTC m=+429.231252133" watchObservedRunningTime="2026-09-17 03:38:22.214971254 +0000 UTC m=+429.232092532" Sep 17 03:38:38.206143 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:38:38.206063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:39:48.586246 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.586215 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:39:48.586764 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.586393 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" podUID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" containerName="manager" containerID="cri-o://1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2" gracePeriod=30 Sep 17 03:39:48.849668 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.849644 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:39:48.976432 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.976399 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dv9x\" (UniqueName: \"kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x\") pod \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " Sep 17 03:39:48.976432 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.976434 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config\") pod \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " Sep 17 03:39:48.976646 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.976464 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert\") pod \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\" (UID: \"d3889988-9e0e-4857-9a95-e9bfc15d6f12\") " Sep 17 03:39:48.978630 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.978591 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert" (OuterVolumeSpecName: "cert") pod "d3889988-9e0e-4857-9a95-e9bfc15d6f12" (UID: "d3889988-9e0e-4857-9a95-e9bfc15d6f12"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:39:48.978766 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.978633 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x" (OuterVolumeSpecName: "kube-api-access-6dv9x") pod "d3889988-9e0e-4857-9a95-e9bfc15d6f12" (UID: "d3889988-9e0e-4857-9a95-e9bfc15d6f12"). InnerVolumeSpecName "kube-api-access-6dv9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:39:48.980719 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:48.980697 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "d3889988-9e0e-4857-9a95-e9bfc15d6f12" (UID: "d3889988-9e0e-4857-9a95-e9bfc15d6f12"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:39:49.077106 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.077070 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dv9x\" (UniqueName: \"kubernetes.io/projected/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kube-api-access-6dv9x\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:39:49.077106 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.077098 2557 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d3889988-9e0e-4857-9a95-e9bfc15d6f12-kubeflow-trainer-config\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:39:49.077106 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.077107 2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3889988-9e0e-4857-9a95-e9bfc15d6f12-cert\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:39:49.519492 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.519455 2557 generic.go:356] "Generic (PLEG): container finished" podID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" containerID="1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2" exitCode=0 Sep 17 03:39:49.519650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.519512 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" Sep 17 03:39:49.519650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.519527 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" event={"ID":"d3889988-9e0e-4857-9a95-e9bfc15d6f12","Type":"ContainerDied","Data":"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2"} Sep 17 03:39:49.519650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.519564 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8" event={"ID":"d3889988-9e0e-4857-9a95-e9bfc15d6f12","Type":"ContainerDied","Data":"2925d8b4650d56a366d9f7686df89c9acc7cb7323e5d9b9dd74f6de6fd479129"} Sep 17 03:39:49.519650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.519583 2557 scope.go:117] "RemoveContainer" containerID="1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2" Sep 17 03:39:49.528007 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.527990 2557 scope.go:117] "RemoveContainer" containerID="1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2" Sep 17 03:39:49.528278 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:39:49.528261 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2\": container with ID starting with 1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2 not found: ID does not exist" containerID="1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2" Sep 17 03:39:49.528336 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.528284 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2"} err="failed to get container status \"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2\": rpc error: code = NotFound desc = could not find container \"1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2\": container with ID starting with 1282c51c26b2ab253f02333ab9b777f14a254b0db52197d0c62c6dbb0de63ce2 not found: ID does not exist" Sep 17 03:39:49.535148 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.535126 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:39:49.539057 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:49.539038 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-8vcd8"] Sep 17 03:39:50.600125 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.600096 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sr7fx/must-gather-qs7zs"] Sep 17 03:39:50.600486 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.600365 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" containerName="manager" Sep 17 03:39:50.600486 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.600374 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" containerName="manager" Sep 17 03:39:50.600486 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.600433 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" containerName="manager" Sep 17 03:39:50.604675 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.604654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.606894 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.606867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr7fx\"/\"openshift-service-ca.crt\"" Sep 17 03:39:50.606894 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.606896 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr7fx\"/\"kube-root-ca.crt\"" Sep 17 03:39:50.607592 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.607578 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sr7fx\"/\"default-dockercfg-t2nq5\"" Sep 17 03:39:50.611727 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.611649 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr7fx/must-gather-qs7zs"] Sep 17 03:39:50.691139 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.691105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.691314 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.691151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlm6s\" (UniqueName: \"kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.791669 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.791631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.791836 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.791675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlm6s\" (UniqueName: \"kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.792001 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.791983 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.801367 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.801346 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlm6s\" (UniqueName: \"kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s\") pod \"must-gather-qs7zs\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:50.914562 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:50.914477 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:39:51.183073 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:51.182996 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr7fx/must-gather-qs7zs"] Sep 17 03:39:51.186178 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:39:51.186146 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80f74a39_ac6c_4f70_a0ee_997f8ecffa1d.slice/crio-0964f897057a7598529eb903b06aa437bec7f83720650bffd533684cd1ebfc55 WatchSource:0}: Error finding container 0964f897057a7598529eb903b06aa437bec7f83720650bffd533684cd1ebfc55: Status 404 returned error can't find the container with id 0964f897057a7598529eb903b06aa437bec7f83720650bffd533684cd1ebfc55 Sep 17 03:39:51.466769 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:51.466688 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3889988-9e0e-4857-9a95-e9bfc15d6f12" path="/var/lib/kubelet/pods/d3889988-9e0e-4857-9a95-e9bfc15d6f12/volumes" Sep 17 03:39:51.528948 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:51.528920 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" event={"ID":"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d","Type":"ContainerStarted","Data":"0964f897057a7598529eb903b06aa437bec7f83720650bffd533684cd1ebfc55"} Sep 17 03:39:57.561813 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:57.561100 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" event={"ID":"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d","Type":"ContainerStarted","Data":"54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622"} Sep 17 03:39:57.561813 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:57.561151 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" event={"ID":"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d","Type":"ContainerStarted","Data":"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32"} Sep 17 03:39:57.577515 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:39:57.577456 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" podStartSLOduration=1.678791673 podStartE2EDuration="7.577438305s" totalImagesPullingTime="5.898646632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:39:57.576526674 +0000 UTC m=+524.593647952" watchObservedRunningTime="2026-09-17 03:39:57.577438305 +0000 UTC m=+524.594559587" Sep 17 03:40:42.760274 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:42.760242 2557 generic.go:356] "Generic (PLEG): container finished" podID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerID="4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32" exitCode=0 Sep 17 03:40:42.760688 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:42.760316 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" event={"ID":"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d","Type":"ContainerDied","Data":"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32"} Sep 17 03:40:42.760688 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:42.760608 2557 scope.go:117] "RemoveContainer" containerID="4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32" Sep 17 03:40:43.041196 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:43.041120 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sr7fx_must-gather-qs7zs_80f74a39-ac6c-4f70-a0ee-997f8ecffa1d/gather/0.log" Sep 17 03:40:46.284925 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:46.284901 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9fdtp_ef8221a8-307e-4789-97fe-f2a7a6eb6f84/global-pull-secret-syncer/0.log" Sep 17 03:40:46.468121 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:46.468092 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8wssh_b8f5827c-48ca-4e4e-b55a-262dcbf19401/konnectivity-agent/0.log" Sep 17 03:40:46.518583 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:46.518557 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-170.ec2.internal_4b34e8a23bd204528e11ac13c6b9096b/haproxy/0.log" Sep 17 03:40:48.506794 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.506756 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-sr7fx/must-gather-qs7zs"] Sep 17 03:40:48.507299 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.506936 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="copy" containerID="cri-o://54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622" gracePeriod=2 Sep 17 03:40:48.511471 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.511449 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-sr7fx/must-gather-qs7zs"] Sep 17 03:40:48.737714 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.737694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sr7fx_must-gather-qs7zs_80f74a39-ac6c-4f70-a0ee-997f8ecffa1d/copy/0.log" Sep 17 03:40:48.740343 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.740326 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:40:48.742374 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:40:48.742352 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qs7zs\" is forbidden: User \"system:node:ip-10-0-129-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sr7fx\": no relationship found between node 'ip-10-0-129-170.ec2.internal' and this object" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:40:48.788472 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.788387 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sr7fx_must-gather-qs7zs_80f74a39-ac6c-4f70-a0ee-997f8ecffa1d/copy/0.log" Sep 17 03:40:48.788837 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.788813 2557 generic.go:356] "Generic (PLEG): container finished" podID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerID="54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622" exitCode=143 Sep 17 03:40:48.788899 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.788867 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:40:48.788962 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.788874 2557 scope.go:117] "RemoveContainer" containerID="54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622" Sep 17 03:40:48.791049 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:40:48.791023 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qs7zs\" is forbidden: User \"system:node:ip-10-0-129-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sr7fx\": no relationship found between node 'ip-10-0-129-170.ec2.internal' and this object" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:40:48.798130 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.798111 2557 scope.go:117] "RemoveContainer" containerID="4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32" Sep 17 03:40:48.810060 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.810044 2557 scope.go:117] "RemoveContainer" containerID="54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622" Sep 17 03:40:48.810316 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:40:48.810293 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622\": container with ID starting with 54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622 not found: ID does not exist" containerID="54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622" Sep 17 03:40:48.810368 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.810324 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622"} err="failed to get container status \"54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622\": rpc error: code = NotFound desc = could not find container \"54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622\": container with ID starting with 54e9eef809d450f73069d55ab7ba02fcb06cf98792f4ca4b0c15220bd5ac8622 not found: ID does not exist" Sep 17 03:40:48.810368 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.810341 2557 scope.go:117] "RemoveContainer" containerID="4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32" Sep 17 03:40:48.810574 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:40:48.810557 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32\": container with ID starting with 4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32 not found: ID does not exist" containerID="4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32" Sep 17 03:40:48.810626 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.810583 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32"} err="failed to get container status \"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32\": rpc error: code = NotFound desc = could not find container \"4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32\": container with ID starting with 4b0363a732416455ad596174e88c9cf6db840b943976d244f9989cd80d210c32 not found: ID does not exist" Sep 17 03:40:48.855712 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.855687 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output\") pod \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " Sep 17 03:40:48.855831 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.855717 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlm6s\" (UniqueName: \"kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s\") pod \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\" (UID: \"80f74a39-ac6c-4f70-a0ee-997f8ecffa1d\") " Sep 17 03:40:48.856967 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.856944 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" (UID: "80f74a39-ac6c-4f70-a0ee-997f8ecffa1d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:40:48.857905 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.857889 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s" (OuterVolumeSpecName: "kube-api-access-dlm6s") pod "80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" (UID: "80f74a39-ac6c-4f70-a0ee-997f8ecffa1d"). InnerVolumeSpecName "kube-api-access-dlm6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:40:48.957178 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.957135 2557 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-must-gather-output\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:40:48.957178 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:48.957174 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlm6s\" (UniqueName: \"kubernetes.io/projected/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d-kube-api-access-dlm6s\") on node \"ip-10-0-129-170.ec2.internal\" DevicePath \"\"" Sep 17 03:40:49.099467 ip-10-0-129-170 kubenswrapper[2557]: E0917 03:40:49.099434 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qs7zs\" is forbidden: User \"system:node:ip-10-0-129-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sr7fx\": no relationship found between node 'ip-10-0-129-170.ec2.internal' and this object" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" pod="openshift-must-gather-sr7fx/must-gather-qs7zs" Sep 17 03:40:49.466005 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:49.465928 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" path="/var/lib/kubelet/pods/80f74a39-ac6c-4f70-a0ee-997f8ecffa1d/volumes" Sep 17 03:40:51.101876 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.101850 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlm6s_3aa444b4-605f-4ccf-9d39-43982c48d5ea/node-exporter/0.log" Sep 17 03:40:51.125391 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.125369 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlm6s_3aa444b4-605f-4ccf-9d39-43982c48d5ea/kube-rbac-proxy/0.log" Sep 17 03:40:51.156095 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.156076 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlm6s_3aa444b4-605f-4ccf-9d39-43982c48d5ea/init-textfile/0.log" Sep 17 03:40:51.266624 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.266598 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-pz5hg_d43abaf0-c48f-48e3-b19f-e8215720f5ad/kube-rbac-proxy-main/0.log" Sep 17 03:40:51.289627 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.289557 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-pz5hg_d43abaf0-c48f-48e3-b19f-e8215720f5ad/kube-rbac-proxy-self/0.log" Sep 17 03:40:51.313281 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.313260 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-pz5hg_d43abaf0-c48f-48e3-b19f-e8215720f5ad/openshift-state-metrics/0.log" Sep 17 03:40:51.355918 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.355892 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/prometheus/0.log" Sep 17 03:40:51.382908 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.382882 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/config-reloader/0.log" Sep 17 03:40:51.406202 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.406178 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/thanos-sidecar/0.log" Sep 17 03:40:51.439250 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.439226 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/kube-rbac-proxy-web/0.log" Sep 17 03:40:51.466543 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.466520 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/kube-rbac-proxy/0.log" Sep 17 03:40:51.491053 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.491032 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/kube-rbac-proxy-thanos/0.log" Sep 17 03:40:51.514317 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.514293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_358f2d26-85dc-4793-84b5-d0c22c785a7c/init-config-reloader/0.log" Sep 17 03:40:51.620521 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:51.620501 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-dggcv_89a6e59e-9bb8-4824-b690-69ce22ebbf0a/prometheus-operator-admission-webhook/0.log" Sep 17 03:40:53.489487 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489451 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn"] Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489737 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="copy" Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489750 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="copy" Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489761 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="gather" Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489766 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="gather" Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489836 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="copy" Sep 17 03:40:53.489865 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.489844 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f74a39-ac6c-4f70-a0ee-997f8ecffa1d" containerName="gather" Sep 17 03:40:53.494712 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.494694 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.496852 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.496829 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwdb\"/\"openshift-service-ca.crt\"" Sep 17 03:40:53.497594 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.497579 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ffwdb\"/\"default-dockercfg-kjmtr\"" Sep 17 03:40:53.497686 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.497612 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwdb\"/\"kube-root-ca.crt\"" Sep 17 03:40:53.502696 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.502673 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn"] Sep 17 03:40:53.599207 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.599179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-lib-modules\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.599385 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.599217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7zxx\" (UniqueName: \"kubernetes.io/projected/ab96a3c0-8c94-44df-b719-1e427013b84f-kube-api-access-d7zxx\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.599385 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.599252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-proc\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.599385 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.599327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-sys\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.599385 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.599350 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-podres\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700300 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-lib-modules\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700421 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7zxx\" (UniqueName: \"kubernetes.io/projected/ab96a3c0-8c94-44df-b719-1e427013b84f-kube-api-access-d7zxx\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700421 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-proc\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700421 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-sys\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700421 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-podres\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700458 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-lib-modules\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700473 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-proc\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700551 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700492 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-sys\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.700643 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.700554 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab96a3c0-8c94-44df-b719-1e427013b84f-podres\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.707947 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.707924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7zxx\" (UniqueName: \"kubernetes.io/projected/ab96a3c0-8c94-44df-b719-1e427013b84f-kube-api-access-d7zxx\") pod \"perf-node-gather-daemonset-qplpn\" (UID: \"ab96a3c0-8c94-44df-b719-1e427013b84f\") " pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.803968 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.803886 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:53.842942 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:53.842917 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-xgmbb_dc07667a-c80d-468b-97c4-a20ffbb58b98/download-server/0.log" Sep 17 03:40:54.069761 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:54.069731 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn"] Sep 17 03:40:54.073036 ip-10-0-129-170 kubenswrapper[2557]: W0917 03:40:54.073007 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podab96a3c0_8c94_44df_b719_1e427013b84f.slice/crio-5423bdf39656eb77a1d14ec6f72a4d44f6d3fb5b1df708ca2765e815c02efa8c WatchSource:0}: Error finding container 5423bdf39656eb77a1d14ec6f72a4d44f6d3fb5b1df708ca2765e815c02efa8c: Status 404 returned error can't find the container with id 5423bdf39656eb77a1d14ec6f72a4d44f6d3fb5b1df708ca2765e815c02efa8c Sep 17 03:40:54.814086 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:54.814047 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" event={"ID":"ab96a3c0-8c94-44df-b719-1e427013b84f","Type":"ContainerStarted","Data":"082d79a93018124c64129ce650c43cb4dfbbd20efc82a794651eb5abb02e2516"} Sep 17 03:40:54.814478 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:54.814097 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" event={"ID":"ab96a3c0-8c94-44df-b719-1e427013b84f","Type":"ContainerStarted","Data":"5423bdf39656eb77a1d14ec6f72a4d44f6d3fb5b1df708ca2765e815c02efa8c"} Sep 17 03:40:54.814478 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:54.814124 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:40:54.829650 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:54.829595 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" podStartSLOduration=1.829577274 podStartE2EDuration="1.829577274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:40:54.827943788 +0000 UTC m=+581.845065067" watchObservedRunningTime="2026-09-17 03:40:54.829577274 +0000 UTC m=+581.846698554" Sep 17 03:40:55.131152 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:55.131067 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8dtl_8acf9e51-7b5e-4237-89e4-994ba18cc4e0/dns/0.log" Sep 17 03:40:55.154994 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:55.154965 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8dtl_8acf9e51-7b5e-4237-89e4-994ba18cc4e0/kube-rbac-proxy/0.log" Sep 17 03:40:55.224521 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:55.224495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qlxnd_8944b29a-f58b-4577-8194-50e6ab5b9af6/dns-node-resolver/0.log" Sep 17 03:40:55.617389 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:55.617351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4f6d7_d7bcd111-01fa-494c-8b00-b610d67336c2/node-ca/0.log" Sep 17 03:40:56.639328 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:56.639297 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5jt4_ea94a604-929b-48d6-b421-9ecc1a4faf15/serve-healthcheck-canary/0.log" Sep 17 03:40:57.038336 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:57.038210 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tbsh_bf72418f-f5a6-40ef-b89a-5839d95f690f/kube-rbac-proxy/0.log" Sep 17 03:40:57.059708 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:57.059680 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tbsh_bf72418f-f5a6-40ef-b89a-5839d95f690f/exporter/0.log" Sep 17 03:40:57.081321 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:40:57.081303 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5tbsh_bf72418f-f5a6-40ef-b89a-5839d95f690f/extractor/0.log" Sep 17 03:41:00.826390 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:00.826363 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ffwdb/perf-node-gather-daemonset-qplpn" Sep 17 03:41:02.172637 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:02.172567 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-hfr5v_61642717-b30c-42e7-8570-64ff07d8ea5c/kube-storage-version-migrator-operator/1.log" Sep 17 03:41:02.173592 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:02.173578 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-hfr5v_61642717-b30c-42e7-8570-64ff07d8ea5c/kube-storage-version-migrator-operator/0.log" Sep 17 03:41:03.338886 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.338855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/kube-multus-additional-cni-plugins/0.log" Sep 17 03:41:03.359807 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.359731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/egress-router-binary-copy/0.log" Sep 17 03:41:03.380479 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.380438 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/cni-plugins/0.log" Sep 17 03:41:03.400694 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.400667 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/bond-cni-plugin/0.log" Sep 17 03:41:03.421756 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.421732 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/routeoverride-cni/0.log" Sep 17 03:41:03.443598 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.443552 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/whereabouts-cni-bincopy/0.log" Sep 17 03:41:03.464532 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.464500 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6qldr_4f4fa17a-1e79-4868-b5fb-ed3a0cfbf7be/whereabouts-cni/0.log" Sep 17 03:41:03.677683 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.677612 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t8krg_470c11e5-4647-496d-9059-7024cd729d3a/kube-multus/0.log" Sep 17 03:41:03.796993 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.796968 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2tnp_70bed96e-18a3-486e-b8a7-69d23f45c26e/network-metrics-daemon/0.log" Sep 17 03:41:03.819227 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:03.819199 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2tnp_70bed96e-18a3-486e-b8a7-69d23f45c26e/kube-rbac-proxy/0.log" Sep 17 03:41:04.594467 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.594440 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/ovn-controller/0.log" Sep 17 03:41:04.616196 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.616168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/ovn-acl-logging/0.log" Sep 17 03:41:04.638469 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.638445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/kube-rbac-proxy-node/0.log" Sep 17 03:41:04.658181 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.658159 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:41:04.678143 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.678118 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/northd/0.log" Sep 17 03:41:04.698198 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.698167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/nbdb/0.log" Sep 17 03:41:04.717641 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.717621 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/sbdb/0.log" Sep 17 03:41:04.751256 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:04.751227 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsbpp_f6d264c0-7cf7-4e7e-bcbf-59817517a843/ovnkube-controller/0.log" Sep 17 03:41:06.099339 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:06.099307 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8gq5g_a88472e9-bc96-471e-abac-1d68eac6bdc7/network-check-target-container/0.log" Sep 17 03:41:07.042060 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:07.042032 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nhkjr_3614fff1-6e4f-40c7-85a8-6b50cc490509/iptables-alerter/0.log" Sep 17 03:41:07.706759 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:07.706720 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vs5kd_1da58906-5f25-4d55-af14-80fde93cb2e7/tuned/0.log" Sep 17 03:41:09.376109 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:09.376077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-rr59w_d4c41318-b688-40c6-ac92-d57a67b074e5/cluster-samples-operator/0.log" Sep 17 03:41:09.393605 ip-10-0-129-170 kubenswrapper[2557]: I0917 03:41:09.393581 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-rr59w_d4c41318-b688-40c6-ac92-d57a67b074e5/cluster-samples-operator-watch/0.log"