Sep 07 02:54:41.976224 ip-10-0-133-123 systemd[1]: Starting Kubernetes Kubelet... Sep 07 02:54:42.358329 ip-10-0-133-123 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 02:54:42.358329 ip-10-0-133-123 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 02:54:42.358329 ip-10-0-133-123 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 02:54:42.358329 ip-10-0-133-123 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 02:54:42.358329 ip-10-0-133-123 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 02:54:42.359368 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.359307 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 02:54:42.364207 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364193 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.364207 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364207 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364211 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364214 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364218 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364220 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364223 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364226 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364228 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364231 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364234 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364236 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364241 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364245 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364258 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364261 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364264 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364267 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364269 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364272 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364275 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.364273 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364277 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364280 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364283 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364286 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364289 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364291 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364294 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364296 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364299 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364301 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364304 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364307 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364309 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364311 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364314 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364316 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364319 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364321 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364323 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.364763 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364326 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364328 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364331 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364334 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364336 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364339 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364341 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364349 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364352 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364354 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364357 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364359 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364362 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364364 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364367 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364370 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364373 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364375 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364378 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364380 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.365470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364383 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364387 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364389 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364392 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364394 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364399 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364403 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364406 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364409 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364412 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364414 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364417 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364419 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364422 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364424 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364427 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364429 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364432 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364435 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.366123 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364437 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364445 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364448 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364451 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364453 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364456 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364458 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364460 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364463 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364466 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364469 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364471 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364475 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364478 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364481 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364483 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364486 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364488 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364492 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.366593 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.364496 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366078 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366090 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366094 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366097 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366100 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366103 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366106 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366108 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366111 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366113 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366116 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366119 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366121 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366124 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366126 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366130 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366133 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366136 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366139 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.367120 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366141 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366144 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366147 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366150 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366153 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366155 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366158 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366160 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366164 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366166 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366169 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366171 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366174 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366177 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366180 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366183 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366186 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366189 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366191 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366194 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.367708 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366196 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366199 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366202 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366205 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366207 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366210 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366212 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366215 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366217 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366220 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366222 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366231 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366234 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366237 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366240 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366245 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366248 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366251 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366255 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.368253 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366259 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366262 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366264 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366268 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366271 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366274 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366277 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366279 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366282 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366285 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366287 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366290 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366293 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366295 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366298 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366300 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366303 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366305 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366307 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366310 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.368721 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366313 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366315 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366317 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366320 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366323 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366331 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366334 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366336 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366339 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366341 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366344 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366346 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366349 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366351 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366353 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366356 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366359 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366363 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366367 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.369228 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366370 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366373 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366783 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366789 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366792 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366795 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366798 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366801 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366804 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366807 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366809 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366812 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366815 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366817 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366820 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366822 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366825 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366828 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366831 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366834 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.369691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366837 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366839 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366842 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366844 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366847 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366850 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366852 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366855 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366857 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366860 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366863 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366865 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366868 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366871 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366874 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366877 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366879 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366881 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366884 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366887 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.370206 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366890 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366892 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366895 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366897 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366900 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366902 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366905 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366907 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366910 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366912 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366914 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366918 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366920 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366923 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366925 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366928 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366930 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366933 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366937 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.370691 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366940 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366943 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366946 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366949 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366952 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366956 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366980 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366984 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366987 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366990 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366992 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366995 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.366998 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367002 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367005 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367008 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367011 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367013 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367016 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367018 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.371660 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367021 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367024 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367026 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367029 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367033 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367039 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367042 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367045 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367047 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367050 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367052 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367055 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367057 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367060 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367062 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367064 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367068 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367072 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367075 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.372188 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367078 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367081 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367083 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367149 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367179 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367185 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367189 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367193 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367197 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367201 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367205 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367208 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367212 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367215 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367219 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367222 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367225 2564 flags.go:64] FLAG: --cgroup-root="" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367229 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367232 2564 flags.go:64] FLAG: --client-ca-file="" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367237 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367240 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367245 2564 flags.go:64] FLAG: --cluster-domain="" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367247 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367250 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 02:54:42.372657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367253 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367257 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367266 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367269 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367272 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367276 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367279 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367281 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367284 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367287 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367290 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367294 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367297 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367300 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367302 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367305 2564 flags.go:64] FLAG: --enable-server="true" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367308 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367312 2564 flags.go:64] FLAG: --event-burst="100" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367315 2564 flags.go:64] FLAG: --event-qps="50" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367317 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367320 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367323 2564 flags.go:64] FLAG: --eviction-hard="" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367327 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367329 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367332 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 02:54:42.373260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367336 2564 flags.go:64] FLAG: --eviction-soft="" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367339 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367342 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367345 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367348 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367351 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367354 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367357 2564 flags.go:64] FLAG: --feature-gates="" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367360 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367363 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367366 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367369 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367373 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367376 2564 flags.go:64] FLAG: --help="false" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367379 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367382 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367385 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367388 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367391 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367394 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367397 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367400 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367403 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 02:54:42.374164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367406 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367408 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367411 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367414 2564 flags.go:64] FLAG: --kube-reserved="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367417 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367420 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367422 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367425 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367428 2564 flags.go:64] FLAG: --lock-file="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367431 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367434 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367437 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367442 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367446 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367448 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367451 2564 flags.go:64] FLAG: --logging-format="text" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367454 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367457 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367460 2564 flags.go:64] FLAG: --manifest-url="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367463 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367467 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367470 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367474 2564 flags.go:64] FLAG: --max-pods="110" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367477 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367480 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 02:54:42.375253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367483 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367486 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367489 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367492 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367495 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367505 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367508 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367511 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367514 2564 flags.go:64] FLAG: --pod-cidr="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367517 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367522 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367525 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367528 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367531 2564 flags.go:64] FLAG: --port="10250" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367533 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367536 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0692b2f91e8c59552" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367541 2564 flags.go:64] FLAG: --qos-reserved="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367544 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367547 2564 flags.go:64] FLAG: --register-node="true" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367550 2564 flags.go:64] FLAG: --register-with-taints="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367554 2564 flags.go:64] FLAG: --registry-burst="10" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367557 2564 flags.go:64] FLAG: --registry-qps="5" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367562 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367565 2564 flags.go:64] FLAG: --reserved-memory="" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367569 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 02:54:42.376374 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367572 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367575 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367578 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367580 2564 flags.go:64] FLAG: --runonce="false" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367583 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367586 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367589 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367592 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367595 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367597 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367600 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367603 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367606 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367609 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367611 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367614 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367617 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367620 2564 flags.go:64] FLAG: --system-cgroups="" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367623 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367628 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367631 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367634 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367638 2564 flags.go:64] FLAG: --tls-min-version="" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367642 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367645 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 02:54:42.377389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367648 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367651 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367654 2564 flags.go:64] FLAG: --v="2" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367657 2564 flags.go:64] FLAG: --version="false" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367662 2564 flags.go:64] FLAG: --vmodule="" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367666 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.367669 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367787 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367791 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367794 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367796 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367800 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367802 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367805 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367807 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367810 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367813 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367815 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367818 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367820 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367823 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.378305 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367826 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367830 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367834 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367837 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367839 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367842 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367844 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367847 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367849 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367853 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367856 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367859 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367862 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367864 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367867 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367871 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367880 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367883 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367886 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.379177 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367888 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367891 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367893 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367896 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367899 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367901 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367904 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367906 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367909 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367912 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367914 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367917 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367919 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367922 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367932 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367935 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367937 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367940 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367943 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367945 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.379760 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367948 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367951 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367955 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367969 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367972 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367975 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367978 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367981 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367985 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367988 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367996 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.367999 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368001 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368004 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368007 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368010 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368012 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368015 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368018 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.380472 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368020 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368023 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368026 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368028 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368031 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368035 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368039 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368042 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368045 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368048 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368050 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368053 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368055 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368058 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368061 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368065 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368067 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368070 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368074 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.381035 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368077 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368080 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368084 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368087 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368089 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368093 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368096 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.368098 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.368734 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.375739 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.375758 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.375776 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.375784 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375868 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375876 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.381568 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375881 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375886 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375890 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375894 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375898 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375903 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375907 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375914 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375922 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375926 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375930 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375935 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375939 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375943 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375947 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375951 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375956 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375976 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375983 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.381951 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375989 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375995 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.375999 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376003 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376007 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376011 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376016 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376020 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376026 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376031 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376035 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376039 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376043 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376048 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376052 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376056 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376060 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376064 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376068 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376072 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.382470 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376076 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376080 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376084 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376088 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376092 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376096 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376100 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376104 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376109 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376113 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376116 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376121 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376125 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376129 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376133 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376137 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376141 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376146 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376150 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.383239 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376154 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376159 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376164 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376168 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376172 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376176 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376180 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376184 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376188 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376192 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376196 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376200 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376204 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376208 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376212 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376217 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376221 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376225 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376229 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.383866 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376233 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376237 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376241 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376245 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376250 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376254 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376258 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376262 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376266 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376270 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376274 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376281 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376286 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376292 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376296 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376301 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376306 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376310 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376315 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.384441 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376319 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.376327 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376499 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376508 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376513 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376518 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376523 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376527 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376531 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376536 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376540 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376544 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376548 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376552 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376556 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 02:54:42.384924 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376560 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376564 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376568 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376572 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376576 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376580 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376584 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376588 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376592 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376597 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376601 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376605 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376609 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376613 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376617 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376623 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376629 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376636 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376642 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 02:54:42.385451 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376647 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376651 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376656 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376660 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376664 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376668 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376673 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376677 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376682 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376686 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376690 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376709 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376713 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376717 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376722 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376725 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376730 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376733 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376737 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376741 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 02:54:42.386295 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376745 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376750 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376754 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376758 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376762 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376767 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376772 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376776 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376780 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376785 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376790 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376794 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376798 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376802 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376806 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376810 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376814 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376818 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376822 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376826 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 02:54:42.387016 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376830 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376835 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376839 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376847 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376851 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376855 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376859 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376863 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376867 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376871 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376875 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376879 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376883 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376887 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376891 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376896 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376907 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376913 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 02:54:42.387565 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376917 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376921 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376925 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376931 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376936 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376940 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376944 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:42.376949 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.376973 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.377110 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.379655 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.380598 2564 server.go:1019] "Starting client certificate rotation" Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.380702 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 02:54:42.388078 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.380736 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 02:54:42.388415 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.383283 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 02:54:42.388415 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.387110 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 02:54:42.396422 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.396402 2564 log.go:25] "Validated CRI v1 runtime API" Sep 07 02:54:42.400170 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.400154 2564 log.go:25] "Validated CRI v1 image API" Sep 07 02:54:42.401761 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.401740 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 02:54:42.404565 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.404548 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87a5bd06-911e-4186-8be5-7ca744498f74:/dev/nvme0n1p3 e4de70bc-fa70-4383-9ed0-a86d77e12d86:/dev/nvme0n1p4] Sep 07 02:54:42.404634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.404565 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 02:54:42.409498 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.409480 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 02:54:42.410176 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.410072 2564 manager.go:216] Machine: {Timestamp:2026-09-07 02:54:42.408824118 +0000 UTC m=+0.324645960 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106117 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec213e5943dca7b2933509f7607763b4 SystemUUID:ec213e59-43dc-a7b2-9335-09f7607763b4 BootID:c73f5878-4169-49a4-b1a5-1b556f7d6af7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:e0:83:32:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:e0:83:32:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:94:3e:47:95:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 02:54:42.410176 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.410175 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 02:54:42.410271 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.410239 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 02:54:42.412465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.412444 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 02:54:42.412592 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.412467 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 02:54:42.413683 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.413673 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 02:54:42.413723 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.413686 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 02:54:42.413723 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.413694 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 02:54:42.414361 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.414351 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 02:54:42.415150 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.415141 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 02:54:42.419025 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419012 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 07 02:54:42.419141 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419131 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 02:54:42.419179 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419159 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 07 02:54:42.419179 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419168 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 02:54:42.419179 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419178 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 02:54:42.419310 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419186 2564 kubelet.go:398] "Adding apiserver pod source" Sep 07 02:54:42.419310 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419194 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 02:54:42.419512 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419495 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 02:54:42.419569 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.419521 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 02:54:42.421753 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.421737 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 02:54:42.424303 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.424287 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 02:54:42.424377 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.424325 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 02:54:42.426064 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426050 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426073 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426082 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426091 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426105 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426113 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 02:54:42.426132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426133 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 02:54:42.426342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426142 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 02:54:42.426342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426151 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 02:54:42.426342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426160 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 02:54:42.426342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426181 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 02:54:42.426342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426190 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 02:54:42.427006 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.426990 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 02:54:42.427006 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.427006 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 02:54:42.429445 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.429426 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 02:54:42.429501 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.429478 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 02:54:42.429501 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.429476 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 02:54:42.430517 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.430504 2564 server.go:1268] "Started kubelet" Sep 07 02:54:42.430613 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.430589 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 02:54:42.430668 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.430599 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 02:54:42.430714 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.430684 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 02:54:42.431196 ip-10-0-133-123 systemd[1]: Started Kubernetes Kubelet. Sep 07 02:54:42.435302 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.435282 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 02:54:42.435708 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.435676 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbxdk" Sep 07 02:54:42.436187 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.436165 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 02:54:42.437211 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.437188 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 07 02:54:42.440048 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.440030 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbxdk" Sep 07 02:54:42.440864 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.440849 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 02:54:42.440926 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.440863 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 02:54:42.440991 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.440945 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.441468 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441442 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 02:54:42.441468 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441445 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 02:54:42.441593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441474 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 02:54:42.441593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441567 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 07 02:54:42.441593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441575 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 07 02:54:42.441730 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441707 2564 factory.go:55] Registering systemd factory Sep 07 02:54:42.441730 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441720 2564 factory.go:223] Registration of the systemd container factory successfully Sep 07 02:54:42.441918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441900 2564 factory.go:153] Registering CRI-O factory Sep 07 02:54:42.441918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.441918 2564 factory.go:223] Registration of the crio container factory successfully Sep 07 02:54:42.442087 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.442019 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 02:54:42.442087 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.442037 2564 factory.go:103] Registering Raw factory Sep 07 02:54:42.442087 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.442053 2564 manager.go:1196] Started watching for new ooms in manager Sep 07 02:54:42.442361 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.442349 2564 manager.go:349] Starting recovery of all containers Sep 07 02:54:42.444024 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.443998 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 02:54:42.444123 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.444105 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 02:54:42.444998 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.444030 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-123.ec2.internal.18d2ea5be55c861f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-123.ec2.internal,UID:ip-10-0-133-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-123.ec2.internal,},FirstTimestamp:2026-09-07 02:54:42.430477855 +0000 UTC m=+0.346299698,LastTimestamp:2026-09-07 02:54:42.430477855 +0000 UTC m=+0.346299698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-123.ec2.internal,}" Sep 07 02:54:42.451290 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.451195 2564 manager.go:354] Recovery completed Sep 07 02:54:42.455737 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.455726 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.459586 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.459570 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.459645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.459600 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.459645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.459616 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.460213 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.460197 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 02:54:42.460213 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.460211 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 02:54:42.460337 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.460227 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 07 02:54:42.460337 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.460258 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.460994 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.460979 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.461061 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.461005 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.461061 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.461018 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.462227 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.462212 2564 policy_none.go:49] "None policy: Start" Sep 07 02:54:42.462227 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.462229 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 02:54:42.462338 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.462239 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 02:54:42.464171 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.464160 2564 policy_none.go:47] "Start" Sep 07 02:54:42.489644 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.489630 2564 manager.go:337] "Starting Device Plugin manager" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.489670 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.489682 2564 server.go:87] "Starting device plugin registration server" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.489933 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.489943 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.490040 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.490113 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.490123 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.490724 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.490761 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.501079 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.502349 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.502411 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.502430 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.502487 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 02:54:42.515896 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.504568 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 02:54:42.590867 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.590849 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.591573 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.591557 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.591675 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.591587 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.591675 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.591602 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.591675 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.591627 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.597339 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.597325 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.597397 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.597344 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-123.ec2.internal\": node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.603073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.603054 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal"] Sep 07 02:54:42.603139 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.603108 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.603786 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.603767 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.603860 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.603798 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.603860 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.603832 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.606101 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606090 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.606233 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.606264 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606247 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.606719 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606697 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.606781 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606723 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.606781 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606731 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.606781 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606741 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.606781 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606743 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.606781 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.606752 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.606972 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.606946 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.608792 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.608743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.608792 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.608764 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 02:54:42.609371 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.609360 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientMemory" Sep 07 02:54:42.609437 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.609380 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 02:54:42.609437 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.609389 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeHasSufficientPID" Sep 07 02:54:42.635604 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.635588 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-123.ec2.internal\" not found" node="ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.639789 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.639776 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-123.ec2.internal\" not found" node="ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.707910 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.707892 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.742389 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.742368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.742491 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.742412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.742491 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.742456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99eef7e7e59f3a6a1efe5e3f2b7b402f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"99eef7e7e59f3a6a1efe5e3f2b7b402f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.808170 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.808150 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.843485 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.843585 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.843585 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99eef7e7e59f3a6a1efe5e3f2b7b402f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"99eef7e7e59f3a6a1efe5e3f2b7b402f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.843585 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.843698 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99eef7e7e59f3a6a1efe5e3f2b7b402f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-123.ec2.internal\" (UID: \"99eef7e7e59f3a6a1efe5e3f2b7b402f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.843698 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.843570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2c4d1e59a4d5964015a33f1900e1e03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal\" (UID: \"d2c4d1e59a4d5964015a33f1900e1e03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.908768 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:42.908717 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:42.938029 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.938010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:42.942771 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:42.942737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:43.009007 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:43.008985 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:43.109509 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:43.109488 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:43.209950 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:43.209879 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:43.310299 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:43.310270 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:43.380070 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.380033 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 02:54:43.380487 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.380259 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 02:54:43.410528 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:43.410501 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-123.ec2.internal\" not found" Sep 07 02:54:43.439892 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.439871 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 02:54:43.441448 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.441429 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 02:54:43.441448 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.441444 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" Sep 07 02:54:43.442946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.442911 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 02:49:42 +0000 UTC" deadline="2028-04-15 20:16:43.491017286 +0000 UTC" Sep 07 02:54:43.443022 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.442945 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14081h22m0.048074716s" Sep 07 02:54:43.451989 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.451959 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 02:54:43.454584 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.454569 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 02:54:43.456504 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.456490 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" Sep 07 02:54:43.463284 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.463241 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 02:54:43.474871 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.474850 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6cmfs" Sep 07 02:54:43.483063 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.483024 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6cmfs" Sep 07 02:54:43.488514 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:43.488485 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eef7e7e59f3a6a1efe5e3f2b7b402f.slice/crio-91e7a8975b28113f0cb7f861ca5075646ad3a325e46f99c6ca37d57836b63144 WatchSource:0}: Error finding container 91e7a8975b28113f0cb7f861ca5075646ad3a325e46f99c6ca37d57836b63144: Status 404 returned error can't find the container with id 91e7a8975b28113f0cb7f861ca5075646ad3a325e46f99c6ca37d57836b63144 Sep 07 02:54:43.494963 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.494945 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 02:54:43.499690 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:43.499669 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c4d1e59a4d5964015a33f1900e1e03.slice/crio-f5e508b7d06f37182b641a61ff15645a6f6f3bb8024eb6b01b5fa94364379aaa WatchSource:0}: Error finding container f5e508b7d06f37182b641a61ff15645a6f6f3bb8024eb6b01b5fa94364379aaa: Status 404 returned error can't find the container with id f5e508b7d06f37182b641a61ff15645a6f6f3bb8024eb6b01b5fa94364379aaa Sep 07 02:54:43.506272 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.506238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"d2c4d1e59a4d5964015a33f1900e1e03","Type":"ContainerStarted","Data":"f5e508b7d06f37182b641a61ff15645a6f6f3bb8024eb6b01b5fa94364379aaa"} Sep 07 02:54:43.507511 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.507478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" event={"ID":"99eef7e7e59f3a6a1efe5e3f2b7b402f","Type":"ContainerStarted","Data":"91e7a8975b28113f0cb7f861ca5075646ad3a325e46f99c6ca37d57836b63144"} Sep 07 02:54:43.711180 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.711145 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 02:54:43.818851 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:43.818806 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 02:54:44.420180 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.420142 2564 apiserver.go:52] "Watching apiserver" Sep 07 02:54:44.429253 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.429219 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 02:54:44.429768 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.429740 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx","openshift-cluster-node-tuning-operator/tuned-tzrkp","openshift-multus/multus-additional-cni-plugins-gqgbd","openshift-network-diagnostics/network-check-target-pv4jb","openshift-network-operator/iptables-alerter-c6stn","openshift-ovn-kubernetes/ovnkube-node-5b78k","kube-system/global-pull-secret-syncer-zg8r5","kube-system/konnectivity-agent-7vfxg","kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal","openshift-dns/node-resolver-lnt4k","openshift-image-registry/node-ca-52r7c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal","openshift-multus/multus-2m84v","openshift-multus/network-metrics-daemon-2dbzt"] Sep 07 02:54:44.432384 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.432363 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.432504 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.432444 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:44.434738 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.434711 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.437270 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437036 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.437270 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437239 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 02:54:44.437438 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437398 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.437628 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.437740 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lrbm5\"" Sep 07 02:54:44.437812 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.437752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 02:54:44.439242 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.439198 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 02:54:44.439514 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.439496 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:44.439597 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.439565 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:44.439699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.439677 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 02:54:44.440058 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.440042 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bzflv\"" Sep 07 02:54:44.441932 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.441906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.444467 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.444178 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.444467 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.444306 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.444467 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.444421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8xdkt\"" Sep 07 02:54:44.444686 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.444581 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.444795 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.444775 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 02:54:44.446999 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.446979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.447120 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 02:54:44.447189 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447145 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cwq8n\"" Sep 07 02:54:44.447251 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.447180 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:44.447251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447233 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 02:54:44.447251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447248 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.447404 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447350 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.447461 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447350 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 02:54:44.447570 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.447547 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 02:54:44.449788 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.449761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.452628 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452275 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.452628 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452375 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 02:54:44.452628 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g5mzk\"" Sep 07 02:54:44.452884 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452789 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.452884 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-system-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.452884 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-etc-kubernetes\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.452884 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkz27\" (UniqueName: \"kubernetes.io/projected/94030ba7-4360-4f4d-96d3-59015184c1f9-kube-api-access-tkz27\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-system-cni-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.452961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-netns\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-ovn\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-env-overrides\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-script-lib\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453108 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-k8s-cni-cncf-io\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-var-lib-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-bin\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-cni-binary-copy\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-hostroot\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-slash\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-etc-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-node-log\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56dcda98-e80b-45e7-a9e2-deab6740492e-ovn-node-metrics-cert\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-dbus\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-socket-dir-parent\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-kubelet\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx5js\" (UniqueName: \"kubernetes.io/projected/56dcda98-e80b-45e7-a9e2-deab6740492e-kube-api-access-dx5js\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-bin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-conf-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-daemon-config\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cnibin\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/398319e2-50b3-411e-a129-46a60cb2d719-iptables-alerter-script\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-cnibin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.453946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.453934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-netns\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/398319e2-50b3-411e-a129-46a60cb2d719-host-slash\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-systemd-units\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-log-socket\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-config\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-multus\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-multus-certs\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf7hk\" (UniqueName: \"kubernetes.io/projected/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-kube-api-access-mf7hk\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/398319e2-50b3-411e-a129-46a60cb2d719-kube-api-access-27g56\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-kubelet\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-netd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-kubelet-config\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.454645 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-systemd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.454513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.455018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.455482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.455540 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-78ks6\"" Sep 07 02:54:44.455567 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.455558 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.457483 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.457438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wlhr\"" Sep 07 02:54:44.457598 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.457513 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.457598 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.457589 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.457769 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.457747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.462353 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.460316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.463423 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463185 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 02:54:44.463423 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463209 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 02:54:44.463423 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463260 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 02:54:44.463423 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mdqtv\"" Sep 07 02:54:44.463423 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463343 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 02:54:44.463768 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 02:54:44.463827 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.463778 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xp44g\"" Sep 07 02:54:44.486252 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.486194 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 02:49:44 +0000 UTC" deadline="2028-06-04 04:33:24.712917044 +0000 UTC" Sep 07 02:54:44.486252 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.486251 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15265h38m40.226670017s" Sep 07 02:54:44.544700 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.544573 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 02:54:44.555446 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-etc-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.555583 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.555583 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-kubelet\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555583 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-daemon-config\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555583 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-kubelet\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555583 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-etc-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.555611 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx5js\" (UniqueName: \"kubernetes.io/projected/56dcda98-e80b-45e7-a9e2-deab6740492e-kube-api-access-dx5js\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-bin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.555690 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:54:45.055664934 +0000 UTC m=+2.971486782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555701 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-bin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-conf-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysconfig\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.555833 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96579e00-d7ab-45ff-83ad-709af63cba72-hosts-file\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-sys-fs\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555813 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-conf-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/398319e2-50b3-411e-a129-46a60cb2d719-iptables-alerter-script\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-netns\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-tmp\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.555992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-netns\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-systemd-units\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-log-socket\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-systemd-units\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-multus-certs\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-run\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-multus-certs\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-host\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-log-socket\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:44.556401 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/398319e2-50b3-411e-a129-46a60cb2d719-kube-api-access-27g56\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-netd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-kubelet-config\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdhd\" (UniqueName: \"kubernetes.io/projected/bbff0fd2-b442-4c24-925e-fe58e963d82d-kube-api-access-qrdhd\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-kubernetes\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556263 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-netd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-kubelet-config\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-agent-certs\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-daemon-config\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-systemd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-system-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-systemd\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556522 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/398319e2-50b3-411e-a129-46a60cb2d719-iptables-alerter-script\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-etc-kubernetes\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-system-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556618 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-etc-kubernetes\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.557232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-system-cni-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-socket-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e0402f-af8f-4f79-9c32-8c1d82b158d7-host\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556746 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-system-cni-dir\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnfjp\" (UniqueName: \"kubernetes.io/projected/55e0402f-af8f-4f79-9c32-8c1d82b158d7-kube-api-access-pnfjp\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-env-overrides\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-script-lib\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-k8s-cni-cncf-io\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-conf\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96579e00-d7ab-45ff-83ad-709af63cba72-tmp-dir\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-var-lib-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-bin\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.556969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-cni-binary-copy\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-lib-modules\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-slash\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-node-log\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56dcda98-e80b-45e7-a9e2-deab6740492e-ovn-node-metrics-cert\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558054 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-dbus\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-socket-dir-parent\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cnibin\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-cni-bin\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-slash\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-env-overrides\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557268 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-run-k8s-cni-cncf-io\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgfdv\" (UniqueName: \"kubernetes.io/projected/a6843702-0675-4838-a580-8f550cdcf0f2-kube-api-access-dgfdv\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-registration-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-socket-dir-parent\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-cnibin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/176807a7-4091-4662-a33e-0232f384d1f0-dbus\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-sys\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/398319e2-50b3-411e-a129-46a60cb2d719-host-slash\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-config\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.558783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-multus\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf7hk\" (UniqueName: \"kubernetes.io/projected/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-kube-api-access-mf7hk\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-etc-tuned\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557647 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94030ba7-4360-4f4d-96d3-59015184c1f9-cni-binary-copy\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-var-lib-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2jd\" (UniqueName: \"kubernetes.io/projected/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kube-api-access-cl2jd\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-kubelet\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-cnibin\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-node-log\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-kubelet\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-script-lib\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557794 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cnibin\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559406 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-openvswitch\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkz27\" (UniqueName: \"kubernetes.io/projected/94030ba7-4360-4f4d-96d3-59015184c1f9-kube-api-access-tkz27\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.557970 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-host-var-lib-cni-multus\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-modprobe-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lshw\" (UniqueName: \"kubernetes.io/projected/96579e00-d7ab-45ff-83ad-709af63cba72-kube-api-access-9lshw\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-konnectivity-ca\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558313 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/398319e2-50b3-411e-a129-46a60cb2d719-host-slash\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56dcda98-e80b-45e7-a9e2-deab6740492e-ovnkube-config\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-device-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-netns\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-ovn\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.559990 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-host-run-netns\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56dcda98-e80b-45e7-a9e2-deab6740492e-run-ovn\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-hostroot\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-systemd\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-multus-cni-dir\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-var-lib-kubelet\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558571 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94030ba7-4360-4f4d-96d3-59015184c1f9-hostroot\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.560593 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.558631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55e0402f-af8f-4f79-9c32-8c1d82b158d7-serviceca\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.562478 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.562302 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56dcda98-e80b-45e7-a9e2-deab6740492e-ovn-node-metrics-cert\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.568825 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.568804 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:54:44.568941 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.568827 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:54:44.568941 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.568842 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:44.568941 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.568920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:54:45.068902316 +0000 UTC m=+2.984724164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:44.571832 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.571808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf7hk\" (UniqueName: \"kubernetes.io/projected/ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9-kube-api-access-mf7hk\") pod \"multus-additional-cni-plugins-gqgbd\" (UID: \"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9\") " pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.572115 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.572093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx5js\" (UniqueName: \"kubernetes.io/projected/56dcda98-e80b-45e7-a9e2-deab6740492e-kube-api-access-dx5js\") pod \"ovnkube-node-5b78k\" (UID: \"56dcda98-e80b-45e7-a9e2-deab6740492e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.572244 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.572114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/398319e2-50b3-411e-a129-46a60cb2d719-kube-api-access-27g56\") pod \"iptables-alerter-c6stn\" (UID: \"398319e2-50b3-411e-a129-46a60cb2d719\") " pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.572306 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.572260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkz27\" (UniqueName: \"kubernetes.io/projected/94030ba7-4360-4f4d-96d3-59015184c1f9-kube-api-access-tkz27\") pod \"multus-2m84v\" (UID: \"94030ba7-4360-4f4d-96d3-59015184c1f9\") " pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.659762 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-sys\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.659762 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-etc-tuned\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2jd\" (UniqueName: \"kubernetes.io/projected/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kube-api-access-cl2jd\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-modprobe-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lshw\" (UniqueName: \"kubernetes.io/projected/96579e00-d7ab-45ff-83ad-709af63cba72-kube-api-access-9lshw\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-konnectivity-ca\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-sys\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-device-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-systemd\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.659981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-var-lib-kubelet\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-modprobe-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-d\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55e0402f-af8f-4f79-9c32-8c1d82b158d7-serviceca\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660089 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-var-lib-kubelet\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660124 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-device-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-systemd\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysconfig\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96579e00-d7ab-45ff-83ad-709af63cba72-hosts-file\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.660462 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-sys-fs\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-tmp\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-run\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-host\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdhd\" (UniqueName: \"kubernetes.io/projected/bbff0fd2-b442-4c24-925e-fe58e963d82d-kube-api-access-qrdhd\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-kubernetes\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-sys-fs\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-agent-certs\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55e0402f-af8f-4f79-9c32-8c1d82b158d7-serviceca\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/96579e00-d7ab-45ff-83ad-709af63cba72-hosts-file\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-socket-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660583 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-konnectivity-ca\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.660700 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e0402f-af8f-4f79-9c32-8c1d82b158d7-host\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnfjp\" (UniqueName: \"kubernetes.io/projected/55e0402f-af8f-4f79-9c32-8c1d82b158d7-kube-api-access-pnfjp\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660753 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-host\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:44.660769 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:54:45.160750279 +0000 UTC m=+3.076572113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660774 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-run\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661073 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660825 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-kubernetes\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysconfig\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660921 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e0402f-af8f-4f79-9c32-8c1d82b158d7-host\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-conf\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96579e00-d7ab-45ff-83ad-709af63cba72-tmp-dir\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-lib-modules\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgfdv\" (UniqueName: \"kubernetes.io/projected/a6843702-0675-4838-a580-8f550cdcf0f2-kube-api-access-dgfdv\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-registration-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-registration-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661154 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-etc-sysctl-conf\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.660985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9980d5ac-72b5-4349-82c5-8a89157a0f7d-socket-dir\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6843702-0675-4838-a580-8f550cdcf0f2-lib-modules\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.661981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.661271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96579e00-d7ab-45ff-83ad-709af63cba72-tmp-dir\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.662869 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.662850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-etc-tuned\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.663407 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.663376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6843702-0675-4838-a580-8f550cdcf0f2-tmp\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.663713 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.663679 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c4420bc-a4c6-4f1c-9678-916ed8bb910b-agent-certs\") pod \"konnectivity-agent-7vfxg\" (UID: \"7c4420bc-a4c6-4f1c-9678-916ed8bb910b\") " pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.670644 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.670587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgfdv\" (UniqueName: \"kubernetes.io/projected/a6843702-0675-4838-a580-8f550cdcf0f2-kube-api-access-dgfdv\") pod \"tuned-tzrkp\" (UID: \"a6843702-0675-4838-a580-8f550cdcf0f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.671050 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.671018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnfjp\" (UniqueName: \"kubernetes.io/projected/55e0402f-af8f-4f79-9c32-8c1d82b158d7-kube-api-access-pnfjp\") pod \"node-ca-52r7c\" (UID: \"55e0402f-af8f-4f79-9c32-8c1d82b158d7\") " pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.671283 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.671260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdhd\" (UniqueName: \"kubernetes.io/projected/bbff0fd2-b442-4c24-925e-fe58e963d82d-kube-api-access-qrdhd\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:44.671809 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.671790 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lshw\" (UniqueName: \"kubernetes.io/projected/96579e00-d7ab-45ff-83ad-709af63cba72-kube-api-access-9lshw\") pod \"node-resolver-lnt4k\" (UID: \"96579e00-d7ab-45ff-83ad-709af63cba72\") " pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.671911 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.671889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2jd\" (UniqueName: \"kubernetes.io/projected/9980d5ac-72b5-4349-82c5-8a89157a0f7d-kube-api-access-cl2jd\") pod \"aws-ebs-csi-driver-node-qhbwx\" (UID: \"9980d5ac-72b5-4349-82c5-8a89157a0f7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.747172 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.747140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2m84v" Sep 07 02:54:44.754843 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.754820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" Sep 07 02:54:44.766196 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.766176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6stn" Sep 07 02:54:44.772827 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.772805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:54:44.780880 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.780858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" Sep 07 02:54:44.788949 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.788928 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" Sep 07 02:54:44.796037 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.796017 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnt4k" Sep 07 02:54:44.802175 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.802157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52r7c" Sep 07 02:54:44.808219 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.808196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:54:44.815327 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:44.815299 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 02:54:45.065320 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.065292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:45.065517 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.065439 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:45.065517 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.065502 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:54:46.065486234 +0000 UTC m=+3.981308066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:45.165639 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.165602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:45.165834 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.165657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:45.165834 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165773 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:45.165834 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165795 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:54:45.165834 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165813 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:54:45.165834 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165828 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:45.166087 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165848 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:54:46.165826888 +0000 UTC m=+4.081648736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:45.166087 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:45.165880 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:54:46.165862527 +0000 UTC m=+4.081684364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:45.471420 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.471392 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff18a6c7_f5f7_4ccb_a0a1_d4a97b4becf9.slice/crio-b655ebe22a844f467b5e549e91f21a8864726f706d5c054f39b847fc3ab6488e WatchSource:0}: Error finding container b655ebe22a844f467b5e549e91f21a8864726f706d5c054f39b847fc3ab6488e: Status 404 returned error can't find the container with id b655ebe22a844f467b5e549e91f21a8864726f706d5c054f39b847fc3ab6488e Sep 07 02:54:45.472552 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.472524 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9980d5ac_72b5_4349_82c5_8a89157a0f7d.slice/crio-a79167e73e2d6a4d450e6f6eaf5aff7cd092c8d4de070849c4d8b67798940dda WatchSource:0}: Error finding container a79167e73e2d6a4d450e6f6eaf5aff7cd092c8d4de070849c4d8b67798940dda: Status 404 returned error can't find the container with id a79167e73e2d6a4d450e6f6eaf5aff7cd092c8d4de070849c4d8b67798940dda Sep 07 02:54:45.474314 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.474228 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96579e00_d7ab_45ff_83ad_709af63cba72.slice/crio-62e5b33364a59396e6cbf74ccc2c5384aae64369b2444e1cf352a5a48eeb9510 WatchSource:0}: Error finding container 62e5b33364a59396e6cbf74ccc2c5384aae64369b2444e1cf352a5a48eeb9510: Status 404 returned error can't find the container with id 62e5b33364a59396e6cbf74ccc2c5384aae64369b2444e1cf352a5a48eeb9510 Sep 07 02:54:45.476804 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.476778 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6843702_0675_4838_a580_8f550cdcf0f2.slice/crio-c0239e1df434936110a3db17b1f371fce7309e63a3c535c124664a9da5b7893a WatchSource:0}: Error finding container c0239e1df434936110a3db17b1f371fce7309e63a3c535c124664a9da5b7893a: Status 404 returned error can't find the container with id c0239e1df434936110a3db17b1f371fce7309e63a3c535c124664a9da5b7893a Sep 07 02:54:45.479462 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.479348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dcda98_e80b_45e7_a9e2_deab6740492e.slice/crio-f8edd1a4e37066f654d878de29613222112e221064a857df6ad891f8fb200b20 WatchSource:0}: Error finding container f8edd1a4e37066f654d878de29613222112e221064a857df6ad891f8fb200b20: Status 404 returned error can't find the container with id f8edd1a4e37066f654d878de29613222112e221064a857df6ad891f8fb200b20 Sep 07 02:54:45.480049 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.479998 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94030ba7_4360_4f4d_96d3_59015184c1f9.slice/crio-90926464d3cef2be975a40e277dd42e5552028f7f0874406598aaee254d336f5 WatchSource:0}: Error finding container 90926464d3cef2be975a40e277dd42e5552028f7f0874406598aaee254d336f5: Status 404 returned error can't find the container with id 90926464d3cef2be975a40e277dd42e5552028f7f0874406598aaee254d336f5 Sep 07 02:54:45.481457 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.481408 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398319e2_50b3_411e_a129_46a60cb2d719.slice/crio-f6174a637512c0a9e001ebd5b5616369b190b2b62d7dc52fc39cb42cc77dea6d WatchSource:0}: Error finding container f6174a637512c0a9e001ebd5b5616369b190b2b62d7dc52fc39cb42cc77dea6d: Status 404 returned error can't find the container with id f6174a637512c0a9e001ebd5b5616369b190b2b62d7dc52fc39cb42cc77dea6d Sep 07 02:54:45.482393 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.482373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4420bc_a4c6_4f1c_9678_916ed8bb910b.slice/crio-2acb1e680b4d01b0f8f6514f80ab5ff3f5d869f5b82bec5340c207c5f73c01a0 WatchSource:0}: Error finding container 2acb1e680b4d01b0f8f6514f80ab5ff3f5d869f5b82bec5340c207c5f73c01a0: Status 404 returned error can't find the container with id 2acb1e680b4d01b0f8f6514f80ab5ff3f5d869f5b82bec5340c207c5f73c01a0 Sep 07 02:54:45.484816 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:54:45.484790 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e0402f_af8f_4f79_9c32_8c1d82b158d7.slice/crio-50226ddad8e89b60d653df90ac4e51c4988963ea80a7f67aa6b65751db3274a0 WatchSource:0}: Error finding container 50226ddad8e89b60d653df90ac4e51c4988963ea80a7f67aa6b65751db3274a0: Status 404 returned error can't find the container with id 50226ddad8e89b60d653df90ac4e51c4988963ea80a7f67aa6b65751db3274a0 Sep 07 02:54:45.486433 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.486381 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 02:49:44 +0000 UTC" deadline="2028-05-29 16:42:08.648696084 +0000 UTC" Sep 07 02:54:45.486513 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.486433 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15133h47m23.162267426s" Sep 07 02:54:45.511824 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.511800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52r7c" event={"ID":"55e0402f-af8f-4f79-9c32-8c1d82b158d7","Type":"ContainerStarted","Data":"50226ddad8e89b60d653df90ac4e51c4988963ea80a7f67aa6b65751db3274a0"} Sep 07 02:54:45.513362 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.513333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6stn" event={"ID":"398319e2-50b3-411e-a129-46a60cb2d719","Type":"ContainerStarted","Data":"f6174a637512c0a9e001ebd5b5616369b190b2b62d7dc52fc39cb42cc77dea6d"} Sep 07 02:54:45.514820 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.514791 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2m84v" event={"ID":"94030ba7-4360-4f4d-96d3-59015184c1f9","Type":"ContainerStarted","Data":"90926464d3cef2be975a40e277dd42e5552028f7f0874406598aaee254d336f5"} Sep 07 02:54:45.516028 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.516000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnt4k" event={"ID":"96579e00-d7ab-45ff-83ad-709af63cba72","Type":"ContainerStarted","Data":"62e5b33364a59396e6cbf74ccc2c5384aae64369b2444e1cf352a5a48eeb9510"} Sep 07 02:54:45.517307 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.517283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" event={"ID":"9980d5ac-72b5-4349-82c5-8a89157a0f7d","Type":"ContainerStarted","Data":"a79167e73e2d6a4d450e6f6eaf5aff7cd092c8d4de070849c4d8b67798940dda"} Sep 07 02:54:45.521939 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.521908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerStarted","Data":"b655ebe22a844f467b5e549e91f21a8864726f706d5c054f39b847fc3ab6488e"} Sep 07 02:54:45.532483 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.532453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vfxg" event={"ID":"7c4420bc-a4c6-4f1c-9678-916ed8bb910b","Type":"ContainerStarted","Data":"2acb1e680b4d01b0f8f6514f80ab5ff3f5d869f5b82bec5340c207c5f73c01a0"} Sep 07 02:54:45.534946 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.534916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"f8edd1a4e37066f654d878de29613222112e221064a857df6ad891f8fb200b20"} Sep 07 02:54:45.536130 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:45.536106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" event={"ID":"a6843702-0675-4838-a580-8f550cdcf0f2","Type":"ContainerStarted","Data":"c0239e1df434936110a3db17b1f371fce7309e63a3c535c124664a9da5b7893a"} Sep 07 02:54:46.072505 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.072466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:46.072701 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.072637 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:46.072770 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.072720 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:54:48.072697863 +0000 UTC m=+5.988519716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.173294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.173401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.173555 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.173575 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.173588 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.173641 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:54:48.173623797 +0000 UTC m=+6.089445630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:46.174088 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.174072 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:46.174607 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.174120 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:54:48.174104582 +0000 UTC m=+6.089926415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:46.504254 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.504160 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:46.505133 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.504170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:46.505133 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.504303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:46.505133 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.504328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:46.505133 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.504424 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:46.505133 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:46.504522 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:46.545145 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.544844 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2c4d1e59a4d5964015a33f1900e1e03" containerID="872e2f8154d36b7ea56de8ea3fdb9f4d31356dd9c69cf10a4da8b34a422c658f" exitCode=0 Sep 07 02:54:46.545145 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.545087 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"d2c4d1e59a4d5964015a33f1900e1e03","Type":"ContainerDied","Data":"872e2f8154d36b7ea56de8ea3fdb9f4d31356dd9c69cf10a4da8b34a422c658f"} Sep 07 02:54:46.562486 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:46.562260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" event={"ID":"99eef7e7e59f3a6a1efe5e3f2b7b402f","Type":"ContainerStarted","Data":"9ef12e2e0b29a4be9fa02aeb1b584ac56c8be8b199b989ba24269698d0ca76ab"} Sep 07 02:54:47.591380 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:47.591297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" event={"ID":"d2c4d1e59a4d5964015a33f1900e1e03","Type":"ContainerStarted","Data":"b16ff2c6df79b7ebfac8276d735c81b773eee7f33ca6bd5ab657391c7fee0d0b"} Sep 07 02:54:47.606691 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:47.606615 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-123.ec2.internal" podStartSLOduration=3.6065931559999997 podStartE2EDuration="3.606593156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:54:46.58133762 +0000 UTC m=+4.497159477" watchObservedRunningTime="2026-09-07 02:54:47.606593156 +0000 UTC m=+5.522415013" Sep 07 02:54:48.091106 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.091069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:48.091347 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.091264 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:48.091347 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.091328 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:54:52.091309499 +0000 UTC m=+10.007131337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:48.192099 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.192057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:48.192283 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.192125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:48.192409 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192383 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:48.192467 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192455 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:54:52.192434924 +0000 UTC m=+10.108256758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:48.192922 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192898 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:54:48.193028 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192929 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:54:48.193028 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192943 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:48.193028 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.192991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:54:52.19297591 +0000 UTC m=+10.108797747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:48.504304 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.504179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:48.504304 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.504231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:48.504624 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.504373 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:48.504624 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:48.504392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:48.504624 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.504528 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:48.504624 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:48.504617 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:50.503387 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:50.503351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:50.503907 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:50.503351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:50.503907 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:50.503499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:50.503907 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:50.503491 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:50.503907 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:50.503623 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:50.503907 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:50.503767 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:52.136115 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.134211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:52.136115 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.134762 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:52.136115 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.135042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:00.134940758 +0000 UTC m=+18.050762591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.235560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.235677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.235828 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.235887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:55:00.23587292 +0000 UTC m=+18.151694753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.236192 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:54:52.236213 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.236218 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:54:52.236650 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.236233 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:52.236650 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.236291 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:55:00.236274513 +0000 UTC m=+18.152096348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.504184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.504505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.504272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:52.504248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.504607 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:52.504993 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:52.504669 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:54.502777 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:54.502746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:54.503231 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:54.502757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:54.503231 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:54.502893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:54.503231 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:54.502888 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:54.503231 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:54.503002 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:54.503231 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:54.503093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:56.503461 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:56.503426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:56.503973 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:56.503437 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:56.503973 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:56.503570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:56.503973 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:56.503564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:54:56.503973 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:56.503661 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:56.503973 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:56.503737 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:58.503042 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:58.503006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:54:58.503042 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:58.503034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:54:58.503557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:54:58.503006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:54:58.503557 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:58.503123 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:54:58.503557 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:58.503228 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:54:58.503557 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:54:58.503320 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:00.193052 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.193024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:00.193455 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.193124 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:55:00.193455 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.193168 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:16.193155805 +0000 UTC m=+34.108977635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:55:00.294114 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.294086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:00.294248 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.294119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:00.294248 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294228 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:55:00.294248 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294235 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:55:00.294422 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294299 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:55:16.294281092 +0000 UTC m=+34.210102942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:55:00.294422 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294239 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:55:00.294422 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294330 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:55:00.294422 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.294365 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:55:16.294355681 +0000 UTC m=+34.210177511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:55:00.502979 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.502892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:00.502979 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.502903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:00.503182 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.503001 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:00.503182 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.503046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:00.503182 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:00.503095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:00.503335 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:00.503187 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:02.504537 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:02.504365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:02.504537 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:02.504470 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:02.505048 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:02.504540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:02.505048 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:02.504647 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:02.505048 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:02.504685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:02.505048 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:02.504748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:04.502846 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.502667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:04.503653 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.502667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:04.503653 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:04.502934 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:04.503653 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.502743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:04.503653 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:04.503067 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:04.503653 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:04.503134 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:04.639142 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.639116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnt4k" event={"ID":"96579e00-d7ab-45ff-83ad-709af63cba72","Type":"ContainerStarted","Data":"6b472efc279609f9e900b0335ed97d52050a293bb0fe1f12668845963656fbb3"} Sep 07 02:55:04.640550 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.640522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" event={"ID":"9980d5ac-72b5-4349-82c5-8a89157a0f7d","Type":"ContainerStarted","Data":"d1e0624f75893a94f83e36ea90a83286519016cacf13c44ffc7c3ecbe93fea2b"} Sep 07 02:55:04.642004 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.641979 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="21d021609b4b35034ed41bbdaa23e3b7456a7c939686e2409e1d47f8d0581216" exitCode=0 Sep 07 02:55:04.642091 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.642064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"21d021609b4b35034ed41bbdaa23e3b7456a7c939686e2409e1d47f8d0581216"} Sep 07 02:55:04.643481 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.643421 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vfxg" event={"ID":"7c4420bc-a4c6-4f1c-9678-916ed8bb910b","Type":"ContainerStarted","Data":"393339d06dbb3a87fb920f75f72458fba16169f3d1ec8fbbec72ddc72597c8e4"} Sep 07 02:55:04.648135 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.648114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"b749f592924de651ced067b5c50f75a9cb7d69dcedc6e1ccbb8e872936bae019"} Sep 07 02:55:04.648212 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.648168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"2991e5698e9634a7fdcec0ada57d70a26147960f4c0b93767c9c0ae54599fc13"} Sep 07 02:55:04.648212 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.648200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"5f9fb9da52c39aa3e46e3bf8f509af82f9eca16748ba2fb817b9561638ec7677"} Sep 07 02:55:04.648303 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.648236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"303fe86977aff365d669768ef0b257008d75b4ac5e76f36745c64f727cf3a3d1"} Sep 07 02:55:04.648303 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.648277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"cf12f0d900635a72c526fb83e9cc64eeb0a684cb0ef9854f9bff2d020f58429c"} Sep 07 02:55:04.649605 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.649587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" event={"ID":"a6843702-0675-4838-a580-8f550cdcf0f2","Type":"ContainerStarted","Data":"786e15b1dfa1a4d680ba76447501d706cf526fe2607199a32ecc3a4764541eb4"} Sep 07 02:55:04.651156 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.651118 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52r7c" event={"ID":"55e0402f-af8f-4f79-9c32-8c1d82b158d7","Type":"ContainerStarted","Data":"bf5fd36b4e90e9e45a9321aee51f2c0f16a141775888af803aa0533fa1f3cda8"} Sep 07 02:55:04.653365 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.653327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2m84v" event={"ID":"94030ba7-4360-4f4d-96d3-59015184c1f9","Type":"ContainerStarted","Data":"79aea6c51edc71e52b8e85e658558224c83ce451f35920fec7a0313265e5adb2"} Sep 07 02:55:04.662109 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.662036 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-123.ec2.internal" podStartSLOduration=21.66199165 podStartE2EDuration="21.66199165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:54:47.607538707 +0000 UTC m=+5.523360563" watchObservedRunningTime="2026-09-07 02:55:04.66199165 +0000 UTC m=+22.577813484" Sep 07 02:55:04.677127 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.677087 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lnt4k" podStartSLOduration=3.12615537 podStartE2EDuration="21.677074816s" totalImagesPullingTime="18.550919446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:04.676735389 +0000 UTC m=+22.592557243" watchObservedRunningTime="2026-09-07 02:55:04.677074816 +0000 UTC m=+22.592896667" Sep 07 02:55:04.706620 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.706573 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-52r7c" podStartSLOduration=3.168278052 podStartE2EDuration="21.706555445s" totalImagesPullingTime="18.538277393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:04.690184382 +0000 UTC m=+22.606006234" watchObservedRunningTime="2026-09-07 02:55:04.706555445 +0000 UTC m=+22.622377299" Sep 07 02:55:04.706753 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.706707 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2m84v" podStartSLOduration=3.094499146 podStartE2EDuration="21.706700818s" totalImagesPullingTime="18.612201672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:04.705754845 +0000 UTC m=+22.621576696" watchObservedRunningTime="2026-09-07 02:55:04.706700818 +0000 UTC m=+22.622522673" Sep 07 02:55:04.723174 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.723130 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tzrkp" podStartSLOduration=3.172052517 podStartE2EDuration="21.723112302s" totalImagesPullingTime="18.551059785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:04.722577006 +0000 UTC m=+22.638398857" watchObservedRunningTime="2026-09-07 02:55:04.723112302 +0000 UTC m=+22.638934155" Sep 07 02:55:04.737925 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:04.737873 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7vfxg" podStartSLOduration=10.505318515 podStartE2EDuration="21.737856268s" totalImagesPullingTime="11.232537753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:04.737254857 +0000 UTC m=+22.653076710" watchObservedRunningTime="2026-09-07 02:55:04.737856268 +0000 UTC m=+22.653678122" Sep 07 02:55:05.507098 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:05.506874 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 02:55:05.659770 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:05.659680 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"aeda0cd525e27f0ed311f390fa93e0b0535ee1aab49ebeaff773de4bae0b8934"} Sep 07 02:55:05.661404 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:05.661352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6stn" event={"ID":"398319e2-50b3-411e-a129-46a60cb2d719","Type":"ContainerStarted","Data":"17d3b293f5f4cb038a6578562e37c55d297a329e074c2ff53f9c0016aa80c6eb"} Sep 07 02:55:05.663880 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:05.663497 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" event={"ID":"9980d5ac-72b5-4349-82c5-8a89157a0f7d","Type":"ContainerStarted","Data":"e8f4ff5f0e454828aaaab7d758e8d80663b665b9a752fe1d173f232eb1d5766d"} Sep 07 02:55:05.677140 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:05.677090 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c6stn" podStartSLOduration=4.133304154 podStartE2EDuration="22.677072397s" totalImagesPullingTime="18.543768243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:05.676545664 +0000 UTC m=+23.592367513" watchObservedRunningTime="2026-09-07 02:55:05.677072397 +0000 UTC m=+23.592894250" Sep 07 02:55:06.501950 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.501849 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T02:55:05.507095628Z","UUID":"45244678-abab-4677-919d-da0b1e911b10","Handler":null,"Name":"","Endpoint":""} Sep 07 02:55:06.502676 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.502654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:06.502791 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:06.502770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:06.502898 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.502857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:06.502981 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.502914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:06.503046 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:06.503017 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:06.503118 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:06.503096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:06.503828 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.503809 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 02:55:06.503933 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.503852 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 02:55:06.668133 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.668063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" event={"ID":"9980d5ac-72b5-4349-82c5-8a89157a0f7d","Type":"ContainerStarted","Data":"5bf50ae7d2d22bd5d4a6ac01e4b667e381e03d9392740ed73ba5eec28baf72ea"} Sep 07 02:55:06.692201 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:06.692154 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhbwx" podStartSLOduration=3.233640389 podStartE2EDuration="23.692134491s" totalImagesPullingTime="20.458494102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:06.691607656 +0000 UTC m=+24.607429509" watchObservedRunningTime="2026-09-07 02:55:06.692134491 +0000 UTC m=+24.607956345" Sep 07 02:55:07.674618 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:07.674576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"32a86c996775afad2fb08f6d65149ba08e381c48d7533031d699eb098c5fb55e"} Sep 07 02:55:07.825263 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:07.825228 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:55:07.825913 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:07.825892 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:55:08.502778 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:08.502740 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:08.502989 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:08.502741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:08.502989 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:08.502880 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:08.502989 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:08.502910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:08.503159 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:08.503032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:08.503159 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:08.503144 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:08.676793 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:08.676753 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:55:08.677403 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:08.677382 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7vfxg" Sep 07 02:55:09.682494 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.682271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" event={"ID":"56dcda98-e80b-45e7-a9e2-deab6740492e","Type":"ContainerStarted","Data":"6202b7579385d54f88e0480f60a8a731b040efb97695ae846950ed48209469c6"} Sep 07 02:55:09.683156 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.682555 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:09.683156 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.682620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:09.684236 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.684208 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="df0b44c45473841805277402a56d73e9648831b0322c7a3dadd12c60de1dc581" exitCode=0 Sep 07 02:55:09.684511 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.684265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"df0b44c45473841805277402a56d73e9648831b0322c7a3dadd12c60de1dc581"} Sep 07 02:55:09.697986 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.697951 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:09.712111 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:09.709832 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" podStartSLOduration=8.100847142 podStartE2EDuration="26.709814136s" totalImagesPullingTime="18.608966994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:09.709283995 +0000 UTC m=+27.625105846" watchObservedRunningTime="2026-09-07 02:55:09.709814136 +0000 UTC m=+27.625635989" Sep 07 02:55:10.506405 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:10.506380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:10.506551 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:10.506380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:10.506551 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:10.506479 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:10.506677 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:10.506380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:10.506677 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:10.506552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:10.506677 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:10.506648 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:10.686623 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:10.686586 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:10.700520 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:10.700491 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:11.692596 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:11.692560 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="ee656879e46139c1794f09868992e04da0309a7821950807e35380c085dbdf23" exitCode=0 Sep 07 02:55:11.693125 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:11.692631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"ee656879e46139c1794f09868992e04da0309a7821950807e35380c085dbdf23"} Sep 07 02:55:12.505746 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:12.505670 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:12.505870 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:12.505768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:12.505870 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:12.505793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:12.505870 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:12.505783 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:12.505992 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:12.505871 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:12.505992 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:12.505942 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:12.697370 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:12.697332 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="a87b389bb56d81a2fda40636ba6daef93cc8fc93ee1641f2728e37a5860663c8" exitCode=0 Sep 07 02:55:12.697757 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:12.697416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"a87b389bb56d81a2fda40636ba6daef93cc8fc93ee1641f2728e37a5860663c8"} Sep 07 02:55:14.503870 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.503578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:14.504319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.503605 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:14.504319 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.503951 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:14.504319 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.504020 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:14.504319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.503719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:14.504319 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.504128 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:14.880538 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.880501 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zg8r5"] Sep 07 02:55:14.880714 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.880627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:14.880768 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.880731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:14.887578 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.887545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dbzt"] Sep 07 02:55:14.887754 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.887678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:14.887838 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.887806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:14.888008 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.887885 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pv4jb"] Sep 07 02:55:14.888008 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:14.887997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:14.888103 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:14.888086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:16.222728 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.222666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:16.223416 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.222859 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 02:55:16.223416 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.222938 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret podName:176807a7-4091-4662-a33e-0232f384d1f0 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:48.222914286 +0000 UTC m=+66.138736133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret") pod "global-pull-secret-syncer-zg8r5" (UID: "176807a7-4091-4662-a33e-0232f384d1f0") : object "kube-system"/"original-pull-secret" not registered Sep 07 02:55:16.323399 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.323362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:16.323585 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323560 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 02:55:16.323665 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323591 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 02:55:16.323665 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.323589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:16.323665 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323606 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sjskv for pod openshift-network-diagnostics/network-check-target-pv4jb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:55:16.323799 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323668 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:55:16.323799 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323705 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv podName:1b25cbbe-22c0-467a-95fb-eba506f1622b nodeName:}" failed. No retries permitted until 2026-09-07 02:55:48.323684526 +0000 UTC m=+66.239506373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjskv" (UniqueName: "kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv") pod "network-check-target-pv4jb" (UID: "1b25cbbe-22c0-467a-95fb-eba506f1622b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 02:55:16.323799 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.323726 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs podName:bbff0fd2-b442-4c24-925e-fe58e963d82d nodeName:}" failed. No retries permitted until 2026-09-07 02:55:48.323716296 +0000 UTC m=+66.239538135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs") pod "network-metrics-daemon-2dbzt" (UID: "bbff0fd2-b442-4c24-925e-fe58e963d82d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 02:55:16.502784 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.502692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:16.502998 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.502827 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:16.502998 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.502842 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:16.502998 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:16.502865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:16.502998 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.502956 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:16.503199 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:16.503049 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:17.714458 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:17.714425 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="f326ba16d82b8a8a02af4a9085fb02289e40098cca3f8eac0d7630d54e5eca93" exitCode=0 Sep 07 02:55:17.714854 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:17.714479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"f326ba16d82b8a8a02af4a9085fb02289e40098cca3f8eac0d7630d54e5eca93"} Sep 07 02:55:18.506492 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.506453 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:18.506631 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:18.506569 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dbzt" podUID="bbff0fd2-b442-4c24-925e-fe58e963d82d" Sep 07 02:55:18.506631 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.506573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:18.506726 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:18.506634 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pv4jb" podUID="1b25cbbe-22c0-467a-95fb-eba506f1622b" Sep 07 02:55:18.506726 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.506577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:18.506726 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:18.506694 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zg8r5" podUID="176807a7-4091-4662-a33e-0232f384d1f0" Sep 07 02:55:18.720235 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.720064 2564 generic.go:356] "Generic (PLEG): container finished" podID="ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9" containerID="01acb61f92cebf06055d852892f03c07a2f4e2fab6dfa527bbbd308cde2c7aa1" exitCode=0 Sep 07 02:55:18.720235 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.720146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerDied","Data":"01acb61f92cebf06055d852892f03c07a2f4e2fab6dfa527bbbd308cde2c7aa1"} Sep 07 02:55:18.912771 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.912743 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-123.ec2.internal" event="NodeReady" Sep 07 02:55:18.912880 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.912854 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 02:55:18.962708 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.962679 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf72"] Sep 07 02:55:18.987105 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.987088 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h2pql"] Sep 07 02:55:18.987236 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.987220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:18.989623 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.989602 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 02:55:18.989723 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.989709 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 02:55:18.989766 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.989728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t8mwt\"" Sep 07 02:55:18.989766 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:18.989750 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 02:55:19.000951 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.000932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf72"] Sep 07 02:55:19.001040 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.000975 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2pql"] Sep 07 02:55:19.001040 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.000998 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rl5zs"] Sep 07 02:55:19.001040 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.001033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.003782 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.003609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 02:55:19.003782 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.003646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 02:55:19.003782 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.003663 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5sk4w\"" Sep 07 02:55:19.003782 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.003667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 02:55:19.003782 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.003721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 02:55:19.023118 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.023075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rl5zs"] Sep 07 02:55:19.023188 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.023150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.025626 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.025612 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d76zm\"" Sep 07 02:55:19.025797 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.025785 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 02:55:19.025862 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.025848 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 02:55:19.142013 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.141991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrm9c\" (UniqueName: \"kubernetes.io/projected/16790e2e-7d36-4174-93f2-4bded59a314d-kube-api-access-hrm9c\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.142104 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013ad0ec-85be-4acd-939a-ca3d2f827980-config-volume\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.142104 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7065a7c-b577-438e-94c7-d1f10c25f65d-crio-socket\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.142104 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16790e2e-7d36-4174-93f2-4bded59a314d-cert\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.142251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7065a7c-b577-438e-94c7-d1f10c25f65d-data-volume\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.142251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7065a7c-b577-438e-94c7-d1f10c25f65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.142251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013ad0ec-85be-4acd-939a-ca3d2f827980-metrics-tls\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.142251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tlr\" (UniqueName: \"kubernetes.io/projected/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-api-access-s4tlr\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.142251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9x4\" (UniqueName: \"kubernetes.io/projected/013ad0ec-85be-4acd-939a-ca3d2f827980-kube-api-access-nq9x4\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.142400 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.142400 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.142281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013ad0ec-85be-4acd-939a-ca3d2f827980-tmp-dir\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.243270 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrm9c\" (UniqueName: \"kubernetes.io/projected/16790e2e-7d36-4174-93f2-4bded59a314d-kube-api-access-hrm9c\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.243270 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013ad0ec-85be-4acd-939a-ca3d2f827980-config-volume\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.243405 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7065a7c-b577-438e-94c7-d1f10c25f65d-crio-socket\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243405 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16790e2e-7d36-4174-93f2-4bded59a314d-cert\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.243482 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a7065a7c-b577-438e-94c7-d1f10c25f65d-crio-socket\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243482 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7065a7c-b577-438e-94c7-d1f10c25f65d-data-volume\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243580 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7065a7c-b577-438e-94c7-d1f10c25f65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243580 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013ad0ec-85be-4acd-939a-ca3d2f827980-metrics-tls\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.243580 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tlr\" (UniqueName: \"kubernetes.io/projected/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-api-access-s4tlr\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243717 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9x4\" (UniqueName: \"kubernetes.io/projected/013ad0ec-85be-4acd-939a-ca3d2f827980-kube-api-access-nq9x4\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.243717 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.243717 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013ad0ec-85be-4acd-939a-ca3d2f827980-tmp-dir\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.243857 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7065a7c-b577-438e-94c7-d1f10c25f65d-data-volume\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.244007 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.243987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013ad0ec-85be-4acd-939a-ca3d2f827980-config-volume\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.244096 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.244041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013ad0ec-85be-4acd-939a-ca3d2f827980-tmp-dir\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.244318 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.244294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.247789 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.247767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16790e2e-7d36-4174-93f2-4bded59a314d-cert\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.247915 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.247768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a7065a7c-b577-438e-94c7-d1f10c25f65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.247915 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.247767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013ad0ec-85be-4acd-939a-ca3d2f827980-metrics-tls\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.256190 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.256168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tlr\" (UniqueName: \"kubernetes.io/projected/a7065a7c-b577-438e-94c7-d1f10c25f65d-kube-api-access-s4tlr\") pod \"insights-runtime-extractor-h2pql\" (UID: \"a7065a7c-b577-438e-94c7-d1f10c25f65d\") " pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.256535 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.256502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrm9c\" (UniqueName: \"kubernetes.io/projected/16790e2e-7d36-4174-93f2-4bded59a314d-kube-api-access-hrm9c\") pod \"ingress-canary-lrf72\" (UID: \"16790e2e-7d36-4174-93f2-4bded59a314d\") " pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.256675 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.256635 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9x4\" (UniqueName: \"kubernetes.io/projected/013ad0ec-85be-4acd-939a-ca3d2f827980-kube-api-access-nq9x4\") pod \"dns-default-rl5zs\" (UID: \"013ad0ec-85be-4acd-939a-ca3d2f827980\") " pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.295666 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.295647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrf72" Sep 07 02:55:19.308796 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.308777 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2pql" Sep 07 02:55:19.330500 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.330140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:19.627114 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.627037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrf72"] Sep 07 02:55:19.630414 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:19.630393 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16790e2e_7d36_4174_93f2_4bded59a314d.slice/crio-6c7f06107599935fb0c760bdd80e7fa45a3341aa6968bcf26ffaf464bb4d69e0 WatchSource:0}: Error finding container 6c7f06107599935fb0c760bdd80e7fa45a3341aa6968bcf26ffaf464bb4d69e0: Status 404 returned error can't find the container with id 6c7f06107599935fb0c760bdd80e7fa45a3341aa6968bcf26ffaf464bb4d69e0 Sep 07 02:55:19.632169 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.632150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2pql"] Sep 07 02:55:19.634811 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:19.634783 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7065a7c_b577_438e_94c7_d1f10c25f65d.slice/crio-12c9f7acc908426906bb7ac0c437038a34e08df76b7b8c711412a260839e6d4a WatchSource:0}: Error finding container 12c9f7acc908426906bb7ac0c437038a34e08df76b7b8c711412a260839e6d4a: Status 404 returned error can't find the container with id 12c9f7acc908426906bb7ac0c437038a34e08df76b7b8c711412a260839e6d4a Sep 07 02:55:19.668209 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.668088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rl5zs"] Sep 07 02:55:19.670648 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:19.670626 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013ad0ec_85be_4acd_939a_ca3d2f827980.slice/crio-4b6b8b99558bb479866b897c14177476738fafe083967983980b15935da2911c WatchSource:0}: Error finding container 4b6b8b99558bb479866b897c14177476738fafe083967983980b15935da2911c: Status 404 returned error can't find the container with id 4b6b8b99558bb479866b897c14177476738fafe083967983980b15935da2911c Sep 07 02:55:19.725749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.725718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" event={"ID":"ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9","Type":"ContainerStarted","Data":"8ce80f74db6b1b03772e593e0a00a7e531aa224d475e6040816448320d4d2b0f"} Sep 07 02:55:19.726993 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.726952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2pql" event={"ID":"a7065a7c-b577-438e-94c7-d1f10c25f65d","Type":"ContainerStarted","Data":"12c9f7acc908426906bb7ac0c437038a34e08df76b7b8c711412a260839e6d4a"} Sep 07 02:55:19.728003 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.727981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrf72" event={"ID":"16790e2e-7d36-4174-93f2-4bded59a314d","Type":"ContainerStarted","Data":"6c7f06107599935fb0c760bdd80e7fa45a3341aa6968bcf26ffaf464bb4d69e0"} Sep 07 02:55:19.728943 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.728927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rl5zs" event={"ID":"013ad0ec-85be-4acd-939a-ca3d2f827980","Type":"ContainerStarted","Data":"4b6b8b99558bb479866b897c14177476738fafe083967983980b15935da2911c"} Sep 07 02:55:19.748050 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:19.748004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gqgbd" podStartSLOduration=7.893677167 podStartE2EDuration="36.747988602s" totalImagesPullingTime="28.854311435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:19.747849903 +0000 UTC m=+37.663671756" watchObservedRunningTime="2026-09-07 02:55:19.747988602 +0000 UTC m=+37.663810449" Sep 07 02:55:20.503926 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.503877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:20.504130 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.503877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:20.504199 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.504179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:20.506914 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.506890 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 02:55:20.507647 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.507626 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 02:55:20.507793 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.507776 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 02:55:20.507939 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.507925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7wmkn\"" Sep 07 02:55:20.508143 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.508130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 02:55:20.508377 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.508351 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-69s5h\"" Sep 07 02:55:20.734974 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:20.734842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2pql" event={"ID":"a7065a7c-b577-438e-94c7-d1f10c25f65d","Type":"ContainerStarted","Data":"43c8a9c7d847ffa2cdec8b2cddfb22eab0b557b4a4fb54cf535be8ad7e436319"} Sep 07 02:55:21.739079 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:21.739032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2pql" event={"ID":"a7065a7c-b577-438e-94c7-d1f10c25f65d","Type":"ContainerStarted","Data":"9c969d1a59320eb64fe138a1a85bc621200f68cd687a65ed23e14f6bfe50a331"} Sep 07 02:55:23.747286 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.747249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2pql" event={"ID":"a7065a7c-b577-438e-94c7-d1f10c25f65d","Type":"ContainerStarted","Data":"de930c96bc01f2987d642d650a5d5649673759e59046cf678e99fabb5504aafb"} Sep 07 02:55:23.749158 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.749125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrf72" event={"ID":"16790e2e-7d36-4174-93f2-4bded59a314d","Type":"ContainerStarted","Data":"042a638da3b218ab777948381a410755b065a39a6558e3cfff1ef25887b52218"} Sep 07 02:55:23.751248 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.751220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rl5zs" event={"ID":"013ad0ec-85be-4acd-939a-ca3d2f827980","Type":"ContainerStarted","Data":"81e35e901889d0bc51cf001c21dca6cb818fa74d95aff718ef9a1c22dce3f9f2"} Sep 07 02:55:23.751369 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.751272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rl5zs" event={"ID":"013ad0ec-85be-4acd-939a-ca3d2f827980","Type":"ContainerStarted","Data":"2541f53e11caf31a0623ee3f2fd2ae3ca1169563233a3a95fa04e8e49b8e7782"} Sep 07 02:55:23.751369 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.751333 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:23.769018 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.768948 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h2pql" podStartSLOduration=2.479666934 podStartE2EDuration="5.76893493s" totalImagesPullingTime="3.289267996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:55:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:23.767729173 +0000 UTC m=+41.683551025" watchObservedRunningTime="2026-09-07 02:55:23.76893493 +0000 UTC m=+41.684756773" Sep 07 02:55:23.786064 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.786027 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lrf72" podStartSLOduration=2.591044562 podStartE2EDuration="5.786014708s" totalImagesPullingTime="3.194970146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:23.785724661 +0000 UTC m=+41.701546513" watchObservedRunningTime="2026-09-07 02:55:23.786014708 +0000 UTC m=+41.701836560" Sep 07 02:55:23.805575 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:23.805534 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rl5zs" podStartSLOduration=2.6568230980000003 podStartE2EDuration="5.805521076s" totalImagesPullingTime="3.148697978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:23.805096076 +0000 UTC m=+41.720917929" watchObservedRunningTime="2026-09-07 02:55:23.805521076 +0000 UTC m=+41.721342918" Sep 07 02:55:25.547280 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.547246 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:55:25.565665 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.565641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:55:25.565801 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.565729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.569122 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.569094 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 02:55:25.569256 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.569203 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 02:55:25.569256 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.569239 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 02:55:25.569919 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.569897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 02:55:25.570062 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.569898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 02:55:25.570062 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.570050 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nlmn8\"" Sep 07 02:55:25.570170 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.570054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 02:55:25.570170 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.570122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 02:55:25.574547 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.574526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 02:55:25.692439 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vwg\" (UniqueName: \"kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.692790 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.692642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793042 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.792999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vwg\" (UniqueName: \"kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793372 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793372 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793372 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793372 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793372 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793673 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.793880 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.794010 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.793988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.794203 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.794181 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.794276 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.794249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.797114 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.797088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.797202 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.797093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.800659 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.800599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vwg\" (UniqueName: \"kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg\") pod \"console-5754c645d9-pp5w8\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:25.875591 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:25.875546 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:26.183251 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:26.183172 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:55:26.187337 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:26.187293 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b85548_a429_4059_b04a_63b00b8c2abb.slice/crio-4080b637c7010c457ae48385e4c92faa14b6bdcb6d9bf7d1f1f6ed09ae4892c7 WatchSource:0}: Error finding container 4080b637c7010c457ae48385e4c92faa14b6bdcb6d9bf7d1f1f6ed09ae4892c7: Status 404 returned error can't find the container with id 4080b637c7010c457ae48385e4c92faa14b6bdcb6d9bf7d1f1f6ed09ae4892c7 Sep 07 02:55:26.762099 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:26.762058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754c645d9-pp5w8" event={"ID":"c5b85548-a429-4059-b04a-63b00b8c2abb","Type":"ContainerStarted","Data":"4080b637c7010c457ae48385e4c92faa14b6bdcb6d9bf7d1f1f6ed09ae4892c7"} Sep 07 02:55:29.261366 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.261331 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-t674k"] Sep 07 02:55:29.282163 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.282133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-t674k"] Sep 07 02:55:29.282280 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.282229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.284540 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.284516 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 07 02:55:29.284540 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.284507 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 02:55:29.284783 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.284521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 07 02:55:29.285520 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.285504 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 02:55:29.285568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.285527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cvds2\"" Sep 07 02:55:29.285616 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.285510 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 02:55:29.421220 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.421187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.421220 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.421219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2dc\" (UniqueName: \"kubernetes.io/projected/0e5a148d-2746-4b5b-9463-dda672b1360a-kube-api-access-5l2dc\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.421442 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.421302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.421442 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.421339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a148d-2746-4b5b-9463-dda672b1360a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.522747 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.522694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.522747 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.522727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2dc\" (UniqueName: \"kubernetes.io/projected/0e5a148d-2746-4b5b-9463-dda672b1360a-kube-api-access-5l2dc\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.522935 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.522914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.522992 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.522949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a148d-2746-4b5b-9463-dda672b1360a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.523591 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.523560 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5a148d-2746-4b5b-9463-dda672b1360a-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.525012 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.524990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.525237 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.525212 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5a148d-2746-4b5b-9463-dda672b1360a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.531033 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.531007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2dc\" (UniqueName: \"kubernetes.io/projected/0e5a148d-2746-4b5b-9463-dda672b1360a-kube-api-access-5l2dc\") pod \"prometheus-operator-6f4946db56-t674k\" (UID: \"0e5a148d-2746-4b5b-9463-dda672b1360a\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.591016 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.590972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" Sep 07 02:55:29.774752 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.774671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754c645d9-pp5w8" event={"ID":"c5b85548-a429-4059-b04a-63b00b8c2abb","Type":"ContainerStarted","Data":"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584"} Sep 07 02:55:29.792638 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.792582 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5754c645d9-pp5w8" podStartSLOduration=1.556083034 podStartE2EDuration="4.792565994s" totalImagesPullingTime="3.23648296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:29.791665014 +0000 UTC m=+47.707486867" watchObservedRunningTime="2026-09-07 02:55:29.792565994 +0000 UTC m=+47.708387931" Sep 07 02:55:29.873534 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:29.873505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-t674k"] Sep 07 02:55:29.876128 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:29.876107 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5a148d_2746_4b5b_9463_dda672b1360a.slice/crio-d5c0684b6787a0e0dd5228467be9c72fa0e58f0bb5b7ebf3aab7d9f9946c74c4 WatchSource:0}: Error finding container d5c0684b6787a0e0dd5228467be9c72fa0e58f0bb5b7ebf3aab7d9f9946c74c4: Status 404 returned error can't find the container with id d5c0684b6787a0e0dd5228467be9c72fa0e58f0bb5b7ebf3aab7d9f9946c74c4 Sep 07 02:55:30.779486 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:30.779440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" event={"ID":"0e5a148d-2746-4b5b-9463-dda672b1360a","Type":"ContainerStarted","Data":"d5c0684b6787a0e0dd5228467be9c72fa0e58f0bb5b7ebf3aab7d9f9946c74c4"} Sep 07 02:55:31.784861 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:31.784775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" event={"ID":"0e5a148d-2746-4b5b-9463-dda672b1360a","Type":"ContainerStarted","Data":"4537864aba771e24e6f61c30326f5bcdf3968272415321319380d4df70b556fd"} Sep 07 02:55:31.784861 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:31.784835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" event={"ID":"0e5a148d-2746-4b5b-9463-dda672b1360a","Type":"ContainerStarted","Data":"4962e7a9898f0dd7fc003975fd626f2510a3b6209f340951936526e30e3f8161"} Sep 07 02:55:31.801511 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:31.801454 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-t674k" podStartSLOduration=1.208493704 podStartE2EDuration="2.801438687s" totalImagesPullingTime="1.592944983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:31.801098659 +0000 UTC m=+49.716920542" watchObservedRunningTime="2026-09-07 02:55:31.801438687 +0000 UTC m=+49.717260562" Sep 07 02:55:33.626977 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.626927 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z"] Sep 07 02:55:33.628908 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.628892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.631302 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.631278 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 02:55:33.631398 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.631317 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 02:55:33.631398 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.631343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-92zn7\"" Sep 07 02:55:33.636667 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.636647 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-q29sp"] Sep 07 02:55:33.638550 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.638535 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.640996 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.640978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 02:55:33.641481 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.641462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gpfrg\"" Sep 07 02:55:33.641840 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.641824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 02:55:33.642436 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.642423 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 02:55:33.645532 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.645514 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z"] Sep 07 02:55:33.648829 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.648812 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2tpdw"] Sep 07 02:55:33.650733 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.650719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.653184 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.653159 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 02:55:33.653286 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.653204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f8xf9\"" Sep 07 02:55:33.653400 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.653371 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 02:55:33.653505 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.653487 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 02:55:33.655557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.655635 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8990f5ee-41ca-4443-b106-7361914f9d50-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.655635 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/8990f5ee-41ca-4443-b106-7361914f9d50-kube-api-access-dtzdl\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.655635 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.655784 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af3f07f5-d9b5-4d46-afac-5b787f88559a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.655784 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whx9m\" (UniqueName: \"kubernetes.io/projected/af3f07f5-d9b5-4d46-afac-5b787f88559a-kube-api-access-whx9m\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.655894 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.655894 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.655894 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.656084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.655896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.657293 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.657271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-q29sp"] Sep 07 02:55:33.756216 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756192 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rl5zs" Sep 07 02:55:33.756380 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/8990f5ee-41ca-4443-b106-7361914f9d50-kube-api-access-dtzdl\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.756380 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5jn\" (UniqueName: \"kubernetes.io/projected/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-kube-api-access-7m5jn\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.756380 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.756380 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af3f07f5-d9b5-4d46-afac-5b787f88559a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.756571 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.756487 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 07 02:55:33.756571 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whx9m\" (UniqueName: \"kubernetes.io/projected/af3f07f5-d9b5-4d46-afac-5b787f88559a-kube-api-access-whx9m\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.756571 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.756559 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls podName:af3f07f5-d9b5-4d46-afac-5b787f88559a nodeName:}" failed. No retries permitted until 2026-09-07 02:55:34.256540469 +0000 UTC m=+52.172362303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-t8m7z" (UID: "af3f07f5-d9b5-4d46-afac-5b787f88559a") : secret "openshift-state-metrics-tls" not found Sep 07 02:55:33.756732 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-sys\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.756732 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.756732 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.756732 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-metrics-client-ca\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.756778 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.756843 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls podName:8990f5ee-41ca-4443-b106-7361914f9d50 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:34.25682523 +0000 UTC m=+52.172647074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-q29sp" (UID: "8990f5ee-41ca-4443-b106-7361914f9d50") : secret "kube-state-metrics-tls" not found Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.756941 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.757224 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.756977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-root\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.757224 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-textfile\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.757224 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-wtmp\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.757224 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af3f07f5-d9b5-4d46-afac-5b787f88559a-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.757358 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.757358 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.757358 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8990f5ee-41ca-4443-b106-7361914f9d50-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.757506 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757484 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.757571 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8990f5ee-41ca-4443-b106-7361914f9d50-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.757689 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.757668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8990f5ee-41ca-4443-b106-7361914f9d50-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.759390 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.759368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.759592 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.759574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.765183 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.765159 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whx9m\" (UniqueName: \"kubernetes.io/projected/af3f07f5-d9b5-4d46-afac-5b787f88559a-kube-api-access-whx9m\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:33.765478 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.765462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzdl\" (UniqueName: \"kubernetes.io/projected/8990f5ee-41ca-4443-b106-7361914f9d50-kube-api-access-dtzdl\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:33.857699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-sys\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-metrics-client-ca\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857784 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-sys\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-root\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-root\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-textfile\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.857878 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.857890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-wtmp\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.857929 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:33.857935 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls podName:8bc8c959-b1e0-4ae8-8d07-5e222ad9339b nodeName:}" failed. No retries permitted until 2026-09-07 02:55:34.3579165 +0000 UTC m=+52.273738345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls") pod "node-exporter-2tpdw" (UID: "8bc8c959-b1e0-4ae8-8d07-5e222ad9339b") : secret "node-exporter-tls" not found Sep 07 02:55:33.858411 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.858411 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-wtmp\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.858411 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5jn\" (UniqueName: \"kubernetes.io/projected/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-kube-api-access-7m5jn\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.858411 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-textfile\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.858411 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-metrics-client-ca\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.858606 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.858487 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.860188 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.860171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:33.867002 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:33.866955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5jn\" (UniqueName: \"kubernetes.io/projected/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-kube-api-access-7m5jn\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:34.261408 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.261364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:34.261596 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.261423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:34.263732 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.263702 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af3f07f5-d9b5-4d46-afac-5b787f88559a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8m7z\" (UID: \"af3f07f5-d9b5-4d46-afac-5b787f88559a\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:34.263845 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.263757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8990f5ee-41ca-4443-b106-7361914f9d50-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-q29sp\" (UID: \"8990f5ee-41ca-4443-b106-7361914f9d50\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:34.362375 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.362344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:34.364353 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.364335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc8c959-b1e0-4ae8-8d07-5e222ad9339b-node-exporter-tls\") pod \"node-exporter-2tpdw\" (UID: \"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b\") " pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:34.537819 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.537749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" Sep 07 02:55:34.546838 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.546810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" Sep 07 02:55:34.559029 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.559002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tpdw" Sep 07 02:55:34.569340 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:34.569313 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc8c959_b1e0_4ae8_8d07_5e222ad9339b.slice/crio-ac2714a672a3d0d16f7c400800828fcb3712740630e01b17f9055e0a8fef54c2 WatchSource:0}: Error finding container ac2714a672a3d0d16f7c400800828fcb3712740630e01b17f9055e0a8fef54c2: Status 404 returned error can't find the container with id ac2714a672a3d0d16f7c400800828fcb3712740630e01b17f9055e0a8fef54c2 Sep 07 02:55:34.708036 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.708009 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 02:55:34.715594 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.715562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.718260 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718239 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 02:55:34.718381 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 02:55:34.718422 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 02:55:34.718422 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 02:55:34.718674 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 02:55:34.718762 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718661 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 02:55:34.718762 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 02:55:34.718852 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.718773 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 02:55:34.719080 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.719066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2dgsg\"" Sep 07 02:55:34.720458 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.720442 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 02:55:34.728524 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.728502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 02:55:34.766275 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766382 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-config-out\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766382 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766382 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766494 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766494 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766494 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-web-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766597 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766597 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766597 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766696 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhwt\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-kube-api-access-dkhwt\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766696 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.766766 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.766712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.797568 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.797544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tpdw" event={"ID":"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b","Type":"ContainerStarted","Data":"ac2714a672a3d0d16f7c400800828fcb3712740630e01b17f9055e0a8fef54c2"} Sep 07 02:55:34.813666 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.813566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z"] Sep 07 02:55:34.816757 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:34.816736 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3f07f5_d9b5_4d46_afac_5b787f88559a.slice/crio-2a1c021e6d38f5e898859512ad56edbdb05be20374a8680114e9fc035219056a WatchSource:0}: Error finding container 2a1c021e6d38f5e898859512ad56edbdb05be20374a8680114e9fc035219056a: Status 404 returned error can't find the container with id 2a1c021e6d38f5e898859512ad56edbdb05be20374a8680114e9fc035219056a Sep 07 02:55:34.819693 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.819666 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-q29sp"] Sep 07 02:55:34.822266 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:34.822248 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8990f5ee_41ca_4443_b106_7361914f9d50.slice/crio-6dd9fb8f6128c49d5be93137fafb832e9364b7b373e1e884f155579c9a2f2d12 WatchSource:0}: Error finding container 6dd9fb8f6128c49d5be93137fafb832e9364b7b373e1e884f155579c9a2f2d12: Status 404 returned error can't find the container with id 6dd9fb8f6128c49d5be93137fafb832e9364b7b373e1e884f155579c9a2f2d12 Sep 07 02:55:34.867079 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867173 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867173 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867173 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-config-out\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867385 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867385 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867385 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867385 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867385 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-web-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867630 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867630 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867630 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867630 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhwt\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-kube-api-access-dkhwt\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.867836 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.867811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.868029 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:34.868011 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle podName:a9a0f42e-b790-448d-b173-4d0a74edd270 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:35.367991192 +0000 UTC m=+53.283813040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a9a0f42e-b790-448d-b173-4d0a74edd270") : configmap references non-existent config key: ca-bundle.crt Sep 07 02:55:34.868334 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.868271 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.868425 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:34.868401 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 07 02:55:34.868486 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:55:34.868452 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls podName:a9a0f42e-b790-448d-b173-4d0a74edd270 nodeName:}" failed. No retries permitted until 2026-09-07 02:55:35.368433831 +0000 UTC m=+53.284255661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a9a0f42e-b790-448d-b173-4d0a74edd270") : secret "alertmanager-main-tls" not found Sep 07 02:55:34.870216 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.870192 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.870443 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.870426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.872517 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.872476 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9a0f42e-b790-448d-b173-4d0a74edd270-config-out\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.873425 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.873402 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.873613 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.873587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.873931 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.873912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.874040 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.873927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-web-config\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.874267 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.874249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:34.875751 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:34.875726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhwt\" (UniqueName: \"kubernetes.io/projected/a9a0f42e-b790-448d-b173-4d0a74edd270-kube-api-access-dkhwt\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.372268 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.372231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.372447 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.372310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.373132 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.373101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9a0f42e-b790-448d-b173-4d0a74edd270-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.374935 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.374910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9a0f42e-b790-448d-b173-4d0a74edd270-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9a0f42e-b790-448d-b173-4d0a74edd270\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.625821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.625755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 02:55:35.802925 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.802888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" event={"ID":"8990f5ee-41ca-4443-b106-7361914f9d50","Type":"ContainerStarted","Data":"6dd9fb8f6128c49d5be93137fafb832e9364b7b373e1e884f155579c9a2f2d12"} Sep 07 02:55:35.804839 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.804810 2564 generic.go:356] "Generic (PLEG): container finished" podID="8bc8c959-b1e0-4ae8-8d07-5e222ad9339b" containerID="31ac158a59bd2b15daeee9b235166651b975a8ec6519f3714944465798cd2fa2" exitCode=0 Sep 07 02:55:35.804982 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.804898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tpdw" event={"ID":"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b","Type":"ContainerDied","Data":"31ac158a59bd2b15daeee9b235166651b975a8ec6519f3714944465798cd2fa2"} Sep 07 02:55:35.807166 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.807144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" event={"ID":"af3f07f5-d9b5-4d46-afac-5b787f88559a","Type":"ContainerStarted","Data":"d2843c5cb05bc1234ea8932029c0f9324f6d7083bb8198b1ba5487780354ad00"} Sep 07 02:55:35.807263 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.807197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" event={"ID":"af3f07f5-d9b5-4d46-afac-5b787f88559a","Type":"ContainerStarted","Data":"f8fcf8c5bfb43a7f65288e2352fa47fcf4d64e92420f5c0afbc91ec3208e6bc7"} Sep 07 02:55:35.807263 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.807229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" event={"ID":"af3f07f5-d9b5-4d46-afac-5b787f88559a","Type":"ContainerStarted","Data":"2a1c021e6d38f5e898859512ad56edbdb05be20374a8680114e9fc035219056a"} Sep 07 02:55:35.875713 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.875681 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:35.875878 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.875733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:35.881298 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:35.881275 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:36.415644 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.415571 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 02:55:36.418611 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:36.418584 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a0f42e_b790_448d_b173_4d0a74edd270.slice/crio-44737953ebe46a265fc90977ccafaa1cf0bc31e041824f2180013ec42e0d1e14 WatchSource:0}: Error finding container 44737953ebe46a265fc90977ccafaa1cf0bc31e041824f2180013ec42e0d1e14: Status 404 returned error can't find the container with id 44737953ebe46a265fc90977ccafaa1cf0bc31e041824f2180013ec42e0d1e14 Sep 07 02:55:36.813128 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.813082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tpdw" event={"ID":"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b","Type":"ContainerStarted","Data":"9d3e08a09f1fefa2f5fb1dd100b6881b59c8fc5025c14a5230be1550ac4687ec"} Sep 07 02:55:36.813630 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.813152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tpdw" event={"ID":"8bc8c959-b1e0-4ae8-8d07-5e222ad9339b","Type":"ContainerStarted","Data":"eded3e69a7eca8161238387b55498036a47181c9d93630a8848330c34470fe1a"} Sep 07 02:55:36.816063 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.815993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" event={"ID":"af3f07f5-d9b5-4d46-afac-5b787f88559a","Type":"ContainerStarted","Data":"e5b7d23a90c76227b2865711c057289470ddf8b681133fd8b0c205e45250aff6"} Sep 07 02:55:36.817729 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.817700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"44737953ebe46a265fc90977ccafaa1cf0bc31e041824f2180013ec42e0d1e14"} Sep 07 02:55:36.819910 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.819884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" event={"ID":"8990f5ee-41ca-4443-b106-7361914f9d50","Type":"ContainerStarted","Data":"f6191dd56049f2f751d945aa16e29b6a6fbcbbe1f77a07cea3da2eaab94b2f42"} Sep 07 02:55:36.820023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.819939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" event={"ID":"8990f5ee-41ca-4443-b106-7361914f9d50","Type":"ContainerStarted","Data":"c32ef07f9fa34474e7ef35d4d164df82f07d72e51c9291bb96f39ad64d293800"} Sep 07 02:55:36.820023 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.819978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" event={"ID":"8990f5ee-41ca-4443-b106-7361914f9d50","Type":"ContainerStarted","Data":"ef8a48393343ae28053c5a7bbd57e28891197d8c75ddaa76634dee7d7d8a288e"} Sep 07 02:55:36.823721 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.823701 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:55:36.830634 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.830589 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2tpdw" podStartSLOduration=2.941712982 podStartE2EDuration="3.830576302s" totalImagesPullingTime="808.871324ms" totalInitContainerRuntime="79.991996ms" isStatefulPod=true podCreationTimestamp="2026-09-07 02:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:36.829880964 +0000 UTC m=+54.745702815" watchObservedRunningTime="2026-09-07 02:55:36.830576302 +0000 UTC m=+54.746398155" Sep 07 02:55:36.846884 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.846841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-q29sp" podStartSLOduration=2.5325276199999998 podStartE2EDuration="3.846827471s" totalImagesPullingTime="1.314299851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:36.84575404 +0000 UTC m=+54.761575892" watchObservedRunningTime="2026-09-07 02:55:36.846827471 +0000 UTC m=+54.762649322" Sep 07 02:55:36.887421 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:36.887361 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8m7z" podStartSLOduration=2.6655353699999997 podStartE2EDuration="3.887340315s" totalImagesPullingTime="1.221804945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:36.885445359 +0000 UTC m=+54.801267215" watchObservedRunningTime="2026-09-07 02:55:36.887340315 +0000 UTC m=+54.803162167" Sep 07 02:55:37.830609 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:37.830575 2564 generic.go:356] "Generic (PLEG): container finished" podID="a9a0f42e-b790-448d-b173-4d0a74edd270" containerID="f4d6784343c101c977427b5094f965c9ad7e5cd566811461a512de5c9b4d262f" exitCode=0 Sep 07 02:55:37.831050 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:37.830682 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerDied","Data":"f4d6784343c101c977427b5094f965c9ad7e5cd566811461a512de5c9b4d262f"} Sep 07 02:55:39.842114 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.842088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"4f931fd0df552f8bfc7d898b5acdd2a041c24626ca427d7d2de89018c0d510a6"} Sep 07 02:55:39.877018 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.874781 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 02:55:39.896721 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.895152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:39.896721 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.896235 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901625 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901699 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901730 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901864 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.901898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.902065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.902115 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f47ck\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.902267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.902395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4169gd327fiei\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.902954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.903131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 02:55:39.903250 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.903131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 02:55:39.905817 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.904753 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 02:55:39.905817 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:39.905551 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 02:55:40.019435 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019694 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019731 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019784 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-web-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019819 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019867 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.019918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.019913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020064 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020064 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020139 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020139 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-config-out\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020223 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020223 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020223 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.020333 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.020239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhpt\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-kube-api-access-5lhpt\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.121505 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.120955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.121699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.121545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.122425 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.122319 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.122599 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.121575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhpt\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-kube-api-access-5lhpt\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.122749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.122732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.122920 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.122897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.122931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.122977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-web-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123296 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123660 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123660 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123660 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123660 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-config-out\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123660 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123665 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.123918 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.123749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.124236 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.124211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.125261 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.125237 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.125412 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.125387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.125984 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.125943 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.125984 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.125947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.126164 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.126144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.127604 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.127575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-web-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.127702 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.127619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c45f2338-7d44-437e-909e-ffff6399e112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.128626 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.128553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c45f2338-7d44-437e-909e-ffff6399e112-config-out\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.128988 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.128788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.128988 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.128866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.129236 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.129185 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-config\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.129337 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.129317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.129391 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.129356 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.130409 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.130378 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhpt\" (UniqueName: \"kubernetes.io/projected/c45f2338-7d44-437e-909e-ffff6399e112-kube-api-access-5lhpt\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.130657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.130426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.130657 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.130598 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c45f2338-7d44-437e-909e-ffff6399e112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c45f2338-7d44-437e-909e-ffff6399e112\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.234742 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.234716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:40.650325 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.650295 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 02:55:40.653511 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:40.653487 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45f2338_7d44_437e_909e_ffff6399e112.slice/crio-a44a7b38d62ffa6bc8fe205fa72dd581f57c19323cf24a004d656437e8fe5134 WatchSource:0}: Error finding container a44a7b38d62ffa6bc8fe205fa72dd581f57c19323cf24a004d656437e8fe5134: Status 404 returned error can't find the container with id a44a7b38d62ffa6bc8fe205fa72dd581f57c19323cf24a004d656437e8fe5134 Sep 07 02:55:40.848925 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.848898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"51d0b5784d170b7578d5f43fdff5eb5e7c67300520b0093b4b945e698c8c2c3e"} Sep 07 02:55:40.849232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.848990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"a0877bbe1e43328a5d6d671f9cbb917b66147437257f2d664a685a7439859990"} Sep 07 02:55:40.849232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.849038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"8fe7e0effdd59ee703f4d62eb0942807cbf41685d0d8dc6b86f94f50315949e4"} Sep 07 02:55:40.849232 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.849078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"f1bb14e5609e7e4d03743a57876cbb8a23268d7760ddedee5f6f656f558dadd0"} Sep 07 02:55:40.850405 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.850385 2564 generic.go:356] "Generic (PLEG): container finished" podID="c45f2338-7d44-437e-909e-ffff6399e112" containerID="d4eb3c67cfd70ef5c1633dfa37e5220023e9cc043c478b29c9daec166b280491" exitCode=0 Sep 07 02:55:40.850482 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.850418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerDied","Data":"d4eb3c67cfd70ef5c1633dfa37e5220023e9cc043c478b29c9daec166b280491"} Sep 07 02:55:40.850482 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:40.850468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"a44a7b38d62ffa6bc8fe205fa72dd581f57c19323cf24a004d656437e8fe5134"} Sep 07 02:55:41.858991 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:41.858870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9a0f42e-b790-448d-b173-4d0a74edd270","Type":"ContainerStarted","Data":"358b2ca790a6c044a8ddeb5dcf125e320267cc24c7d4aca35e92b2891ab8052f"} Sep 07 02:55:41.900564 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:41.900517 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.282649943 podStartE2EDuration="7.900501952s" totalImagesPullingTime="3.60240727s" totalInitContainerRuntime="15.444739ms" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:41.899146998 +0000 UTC m=+59.814968851" watchObservedRunningTime="2026-09-07 02:55:41.900501952 +0000 UTC m=+59.816323804" Sep 07 02:55:42.708754 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:42.708724 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5b78k" Sep 07 02:55:43.871386 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:43.871354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"a6962108bdafad93f3d71c7726d4ef8975d2e85076bd8a4bdb60c2021095dfa7"} Sep 07 02:55:43.871761 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:43.871420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"959f59ba773b782fe112e0a3ddacc124cc5e1bd86b7188583340f7c9a4eb84c4"} Sep 07 02:55:45.888484 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:45.888447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"b2558e3ab965bf276c64981da2c46d4305449a009eceff9220be724bad9d8505"} Sep 07 02:55:45.888820 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:45.888556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"51cfdb43280df08e90ec4c8d3be3e5ef0933ce5181885e7bd728091d27fbab39"} Sep 07 02:55:45.888820 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:45.888600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"e33c1c6c949da3e59e8bddf90ceadab211c911261696437d28a91cc54ab19958"} Sep 07 02:55:45.888820 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:45.888638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c45f2338-7d44-437e-909e-ffff6399e112","Type":"ContainerStarted","Data":"ae5019c0c8f1bf45307e1dc931415cfbffdc7769a7088c1145e8e5caec08ac4b"} Sep 07 02:55:45.915262 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:45.915216 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.489664133 podStartE2EDuration="6.915199964s" totalImagesPullingTime="4.388904447s" totalInitContainerRuntime="36.631384ms" isStatefulPod=false podCreationTimestamp="2026-09-07 02:55:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:45.914109002 +0000 UTC m=+63.829930853" watchObservedRunningTime="2026-09-07 02:55:45.915199964 +0000 UTC m=+63.831021815" Sep 07 02:55:48.296598 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.296560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:48.299194 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.299168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 02:55:48.309603 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.309570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/176807a7-4091-4662-a33e-0232f384d1f0-original-pull-secret\") pod \"global-pull-secret-syncer-zg8r5\" (UID: \"176807a7-4091-4662-a33e-0232f384d1f0\") " pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:48.397109 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.397077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:48.397234 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.397123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:48.399709 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.399687 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 02:55:48.399827 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.399742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 02:55:48.410122 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.410101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbff0fd2-b442-4c24-925e-fe58e963d82d-metrics-certs\") pod \"network-metrics-daemon-2dbzt\" (UID: \"bbff0fd2-b442-4c24-925e-fe58e963d82d\") " pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:48.410225 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.410183 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 02:55:48.420191 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.420166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjskv\" (UniqueName: \"kubernetes.io/projected/1b25cbbe-22c0-467a-95fb-eba506f1622b-kube-api-access-sjskv\") pod \"network-check-target-pv4jb\" (UID: \"1b25cbbe-22c0-467a-95fb-eba506f1622b\") " pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:48.429272 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.429252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-69s5h\"" Sep 07 02:55:48.434051 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.434033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zg8r5" Sep 07 02:55:48.437503 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.437485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dbzt" Sep 07 02:55:48.708945 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.708867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zg8r5"] Sep 07 02:55:48.710435 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.710417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dbzt"] Sep 07 02:55:48.711649 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:48.711624 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbff0fd2_b442_4c24_925e_fe58e963d82d.slice/crio-a6c86c11535c33e05e97c3f30990bea9805c48c5cf76b3888ea1e04019fcbced WatchSource:0}: Error finding container a6c86c11535c33e05e97c3f30990bea9805c48c5cf76b3888ea1e04019fcbced: Status 404 returned error can't find the container with id a6c86c11535c33e05e97c3f30990bea9805c48c5cf76b3888ea1e04019fcbced Sep 07 02:55:48.712406 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:48.712323 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176807a7_4091_4662_a33e_0232f384d1f0.slice/crio-7dee4e510b7948d1ff420d2e1e984f64c874fbed66f28d2bcc9a0732461cda61 WatchSource:0}: Error finding container 7dee4e510b7948d1ff420d2e1e984f64c874fbed66f28d2bcc9a0732461cda61: Status 404 returned error can't find the container with id 7dee4e510b7948d1ff420d2e1e984f64c874fbed66f28d2bcc9a0732461cda61 Sep 07 02:55:48.720834 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.720816 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7wmkn\"" Sep 07 02:55:48.729395 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.729373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:48.902040 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.902008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zg8r5" event={"ID":"176807a7-4091-4662-a33e-0232f384d1f0","Type":"ContainerStarted","Data":"7dee4e510b7948d1ff420d2e1e984f64c874fbed66f28d2bcc9a0732461cda61"} Sep 07 02:55:48.903262 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.903235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dbzt" event={"ID":"bbff0fd2-b442-4c24-925e-fe58e963d82d","Type":"ContainerStarted","Data":"a6c86c11535c33e05e97c3f30990bea9805c48c5cf76b3888ea1e04019fcbced"} Sep 07 02:55:48.996350 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:48.996321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pv4jb"] Sep 07 02:55:48.999169 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:55:48.999139 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b25cbbe_22c0_467a_95fb_eba506f1622b.slice/crio-bd43489407df5247f707c9abf9807e8eb654c440bd6ecc2b83572c0560ec7120 WatchSource:0}: Error finding container bd43489407df5247f707c9abf9807e8eb654c440bd6ecc2b83572c0560ec7120: Status 404 returned error can't find the container with id bd43489407df5247f707c9abf9807e8eb654c440bd6ecc2b83572c0560ec7120 Sep 07 02:55:49.910653 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:49.910545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pv4jb" event={"ID":"1b25cbbe-22c0-467a-95fb-eba506f1622b","Type":"ContainerStarted","Data":"bd43489407df5247f707c9abf9807e8eb654c440bd6ecc2b83572c0560ec7120"} Sep 07 02:55:49.913140 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:49.913105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dbzt" event={"ID":"bbff0fd2-b442-4c24-925e-fe58e963d82d","Type":"ContainerStarted","Data":"8c1978f4005290352b362897d8317f190b3df6be2e1ea0137937501ba361a6a3"} Sep 07 02:55:49.913302 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:49.913160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dbzt" event={"ID":"bbff0fd2-b442-4c24-925e-fe58e963d82d","Type":"ContainerStarted","Data":"eb2fb3dc5c7f61c389296ca6ffa5322eab40885e31f73949c355f6fd65fb1286"} Sep 07 02:55:49.937708 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:49.937640 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2dbzt" podStartSLOduration=66.029741562 podStartE2EDuration="1m6.937615211s" totalImagesPullingTime="907.873649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:49.936069585 +0000 UTC m=+67.851891437" watchObservedRunningTime="2026-09-07 02:55:49.937615211 +0000 UTC m=+67.853437063" Sep 07 02:55:50.235478 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:50.235287 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:55:54.436159 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.436128 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:55:54.946538 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.946499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zg8r5" event={"ID":"176807a7-4091-4662-a33e-0232f384d1f0","Type":"ContainerStarted","Data":"d5db34a5a586cbc35074b7533316b3a046030ec39a34e1d06c17b4e53dbdc731"} Sep 07 02:55:54.948027 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.947998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pv4jb" event={"ID":"1b25cbbe-22c0-467a-95fb-eba506f1622b","Type":"ContainerStarted","Data":"1b6a5e4b989dee7d591a79e4fb02a6c7cb476a8f3b7c10e2959137946d830261"} Sep 07 02:55:54.948174 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.948121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:55:54.961332 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.961287 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zg8r5" podStartSLOduration=66.66029539 podStartE2EDuration="1m11.961274314s" totalImagesPullingTime="5.300978924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:54.960570265 +0000 UTC m=+72.876392119" watchObservedRunningTime="2026-09-07 02:55:54.961274314 +0000 UTC m=+72.877096166" Sep 07 02:55:54.976033 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:55:54.975980 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pv4jb" podStartSLOduration=66.973113216 podStartE2EDuration="1m11.975950662s" totalImagesPullingTime="5.002837446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:55:54.975002707 +0000 UTC m=+72.890824561" watchObservedRunningTime="2026-09-07 02:55:54.975950662 +0000 UTC m=+72.891772513" Sep 07 02:56:19.456726 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.456368 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5754c645d9-pp5w8" podUID="c5b85548-a429-4059-b04a-63b00b8c2abb" containerName="console" containerID="cri-o://7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584" gracePeriod=15 Sep 07 02:56:19.755533 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.751671 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:56:19.767617 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767594 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767633 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767657 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767680 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767749 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767725 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767972 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.767972 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767785 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2vwg\" (UniqueName: \"kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg\") pod \"c5b85548-a429-4059-b04a-63b00b8c2abb\" (UID: \"c5b85548-a429-4059-b04a-63b00b8c2abb\") " Sep 07 02:56:19.768084 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.767950 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca" (OuterVolumeSpecName: "service-ca") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 02:56:19.768190 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.768147 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 02:56:19.768190 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.768168 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 02:56:19.768453 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.768405 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config" (OuterVolumeSpecName: "console-config") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 02:56:19.770066 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.770035 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg" (OuterVolumeSpecName: "kube-api-access-s2vwg") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "kube-api-access-s2vwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 02:56:19.770167 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.770123 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 02:56:19.770243 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.770225 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c5b85548-a429-4059-b04a-63b00b8c2abb" (UID: "c5b85548-a429-4059-b04a-63b00b8c2abb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 02:56:19.868648 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868613 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868648 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868646 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868663 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2vwg\" (UniqueName: \"kubernetes.io/projected/c5b85548-a429-4059-b04a-63b00b8c2abb-kube-api-access-s2vwg\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868677 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b85548-a429-4059-b04a-63b00b8c2abb-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868693 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868709 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:19.868821 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:19.868721 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b85548-a429-4059-b04a-63b00b8c2abb-trusted-ca-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 02:56:20.049163 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.049133 2564 generic.go:356] "Generic (PLEG): container finished" podID="c5b85548-a429-4059-b04a-63b00b8c2abb" containerID="7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584" exitCode=0 Sep 07 02:56:20.049319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.049199 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5754c645d9-pp5w8" Sep 07 02:56:20.049319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.049215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754c645d9-pp5w8" event={"ID":"c5b85548-a429-4059-b04a-63b00b8c2abb","Type":"ContainerDied","Data":"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584"} Sep 07 02:56:20.049319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.049266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5754c645d9-pp5w8" event={"ID":"c5b85548-a429-4059-b04a-63b00b8c2abb","Type":"ContainerDied","Data":"4080b637c7010c457ae48385e4c92faa14b6bdcb6d9bf7d1f1f6ed09ae4892c7"} Sep 07 02:56:20.049319 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.049288 2564 scope.go:117] "RemoveContainer" containerID="7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584" Sep 07 02:56:20.059091 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.059067 2564 scope.go:117] "RemoveContainer" containerID="7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584" Sep 07 02:56:20.059408 ip-10-0-133-123 kubenswrapper[2564]: E0907 02:56:20.059382 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584\": container with ID starting with 7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584 not found: ID does not exist" containerID="7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584" Sep 07 02:56:20.059534 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.059417 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584"} err="failed to get container status \"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584\": rpc error: code = NotFound desc = could not find container \"7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584\": container with ID starting with 7e899cc09ecdfae6d3012a1457ee113e57af9773ae2edcd3deeac1871a0ae584 not found: ID does not exist" Sep 07 02:56:20.074083 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.074033 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:56:20.080544 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.080424 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5754c645d9-pp5w8"] Sep 07 02:56:20.508476 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:20.508399 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b85548-a429-4059-b04a-63b00b8c2abb" path="/var/lib/kubelet/pods/c5b85548-a429-4059-b04a-63b00b8c2abb/volumes" Sep 07 02:56:23.831832 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:23.831793 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:56:23.852440 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:23.852413 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:56:24.082785 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:24.082711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 02:56:25.955553 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:56:25.955508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pv4jb" Sep 07 02:57:07.861837 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.861800 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 02:57:07.862508 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.862282 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b85548-a429-4059-b04a-63b00b8c2abb" containerName="console" Sep 07 02:57:07.862508 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.862303 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b85548-a429-4059-b04a-63b00b8c2abb" containerName="console" Sep 07 02:57:07.862508 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.862393 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5b85548-a429-4059-b04a-63b00b8c2abb" containerName="console" Sep 07 02:57:07.864280 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.864254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.866699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.866676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 02:57:07.866699 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.866686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 02:57:07.866867 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.866686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 02:57:07.867455 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.867428 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 02:57:07.867686 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.867668 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 02:57:07.867752 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.867700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nlmn8\"" Sep 07 02:57:07.867814 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.867700 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 02:57:07.867994 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.867954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 02:57:07.876823 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.876790 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 02:57:07.877486 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.877455 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 02:57:07.965575 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965669 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965669 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965669 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965770 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965770 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:07.965770 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:07.965727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbc7\" (UniqueName: \"kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066557 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066716 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066716 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066716 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbc7\" (UniqueName: \"kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066716 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.066903 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.066720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.067453 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.067429 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.067573 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.067497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.067573 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.067542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.067698 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.067542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.069027 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.069002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.069213 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.069196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.075870 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.075848 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbc7\" (UniqueName: \"kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7\") pod \"console-7f5c474495-5p5vc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.177858 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.177810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:08.445272 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:08.445205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 02:57:08.448884 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:57:08.448860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61beaa06_11ee_43e7_a008_cb5fc78a42bc.slice/crio-cf09d0180f3d68badbe44a03789e74544cc1699bca640c9f600d15637609bcee WatchSource:0}: Error finding container cf09d0180f3d68badbe44a03789e74544cc1699bca640c9f600d15637609bcee: Status 404 returned error can't find the container with id cf09d0180f3d68badbe44a03789e74544cc1699bca640c9f600d15637609bcee Sep 07 02:57:09.238283 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:09.238245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c474495-5p5vc" event={"ID":"61beaa06-11ee-43e7-a008-cb5fc78a42bc","Type":"ContainerStarted","Data":"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7"} Sep 07 02:57:09.238711 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:09.238296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c474495-5p5vc" event={"ID":"61beaa06-11ee-43e7-a008-cb5fc78a42bc","Type":"ContainerStarted","Data":"cf09d0180f3d68badbe44a03789e74544cc1699bca640c9f600d15637609bcee"} Sep 07 02:57:09.258277 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:09.258225 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5c474495-5p5vc" podStartSLOduration=2.258207178 podStartE2EDuration="2.258207178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:57:09.256887064 +0000 UTC m=+147.172708916" watchObservedRunningTime="2026-09-07 02:57:09.258207178 +0000 UTC m=+147.174029031" Sep 07 02:57:18.178362 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:18.178322 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:18.178846 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:18.178404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:18.183126 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:18.183100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:57:18.281460 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:57:18.281435 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 02:58:23.456983 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.456937 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-csh9k"] Sep 07 02:58:23.460194 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.460173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.462527 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.462495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 02:58:23.463298 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.463279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-2lrkx\"" Sep 07 02:58:23.463399 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.463316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 02:58:23.467361 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.467324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-csh9k"] Sep 07 02:58:23.602465 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.602432 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3e3180-ef39-488f-97c5-827372379825-tmp\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.602592 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.602471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hfq\" (UniqueName: \"kubernetes.io/projected/3f3e3180-ef39-488f-97c5-827372379825-kube-api-access-75hfq\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.702869 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.702821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3e3180-ef39-488f-97c5-827372379825-tmp\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.703022 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.702884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hfq\" (UniqueName: \"kubernetes.io/projected/3f3e3180-ef39-488f-97c5-827372379825-kube-api-access-75hfq\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.703238 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.703217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f3e3180-ef39-488f-97c5-827372379825-tmp\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.711540 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.711482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hfq\" (UniqueName: \"kubernetes.io/projected/3f3e3180-ef39-488f-97c5-827372379825-kube-api-access-75hfq\") pod \"jobset-operator-5bc45f897-csh9k\" (UID: \"3f3e3180-ef39-488f-97c5-827372379825\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:23.779220 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:23.779185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" Sep 07 02:58:24.054342 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:24.054297 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-csh9k"] Sep 07 02:58:24.056819 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:58:24.056795 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f3e3180_ef39_488f_97c5_827372379825.slice/crio-7be1b365469c97ea761c7d4b3ecf7b986e0007727118a83d4c31883610a8f564 WatchSource:0}: Error finding container 7be1b365469c97ea761c7d4b3ecf7b986e0007727118a83d4c31883610a8f564: Status 404 returned error can't find the container with id 7be1b365469c97ea761c7d4b3ecf7b986e0007727118a83d4c31883610a8f564 Sep 07 02:58:24.521528 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:24.521491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" event={"ID":"3f3e3180-ef39-488f-97c5-827372379825","Type":"ContainerStarted","Data":"7be1b365469c97ea761c7d4b3ecf7b986e0007727118a83d4c31883610a8f564"} Sep 07 02:58:27.535368 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:27.535331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" event={"ID":"3f3e3180-ef39-488f-97c5-827372379825","Type":"ContainerStarted","Data":"327b1ce249794a69d43d8747672e1018dcce724abaf5aa3d10b236a4d7ca1b49"} Sep 07 02:58:27.551171 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:58:27.551122 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-csh9k" podStartSLOduration=1.860083356 podStartE2EDuration="4.551106866s" totalImagesPullingTime="2.69102351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:58:27.549532169 +0000 UTC m=+225.465354020" watchObservedRunningTime="2026-09-07 02:58:27.551106866 +0000 UTC m=+225.466928718" Sep 07 02:59:28.168622 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.168589 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 02:59:28.170726 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.170708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.173128 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.173104 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 02:59:28.173284 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.173102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-metrics-tls\"" Sep 07 02:59:28.174001 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.173984 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Sep 07 02:59:28.174098 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.174034 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-6dz94\"" Sep 07 02:59:28.179978 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.179936 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 02:59:28.330838 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.330794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.331065 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.330874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmqr\" (UniqueName: \"kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.331065 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.330897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.331065 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.330944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.432496 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.432379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.432496 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.432480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.432671 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.432547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmqr\" (UniqueName: \"kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.432671 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.432576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.433046 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.433012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.433046 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.433021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.435143 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.435115 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.441172 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.441137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmqr\" (UniqueName: \"kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr\") pod \"trainer-operator-controller-manager-668cdd7dcf-7rp6f\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.482107 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.482050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:28.752750 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.752664 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 02:59:28.755698 ip-10-0-133-123 kubenswrapper[2564]: W0907 02:59:28.755671 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d3ad24_45ae_4b98_923f_3bf77b5204e5.slice/crio-c32c4bb55aee232799f7c8a46f625290ce42d44b00b43008df8607910525d949 WatchSource:0}: Error finding container c32c4bb55aee232799f7c8a46f625290ce42d44b00b43008df8607910525d949: Status 404 returned error can't find the container with id c32c4bb55aee232799f7c8a46f625290ce42d44b00b43008df8607910525d949 Sep 07 02:59:28.779030 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:28.778991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" event={"ID":"75d3ad24-45ae-4b98-923f-3bf77b5204e5","Type":"ContainerStarted","Data":"c32c4bb55aee232799f7c8a46f625290ce42d44b00b43008df8607910525d949"} Sep 07 02:59:31.804576 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:31.804544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" event={"ID":"75d3ad24-45ae-4b98-923f-3bf77b5204e5","Type":"ContainerStarted","Data":"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958"} Sep 07 02:59:31.804934 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:31.804606 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 02:59:31.820470 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:31.820416 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" podStartSLOduration=1.21979638 podStartE2EDuration="3.820401534s" totalImagesPullingTime="2.600605154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 02:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 02:59:31.819907945 +0000 UTC m=+289.735729814" watchObservedRunningTime="2026-09-07 02:59:31.820401534 +0000 UTC m=+289.736223404" Sep 07 02:59:42.463420 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:42.463390 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 02:59:42.810760 ip-10-0-133-123 kubenswrapper[2564]: I0907 02:59:42.810731 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 03:00:15.498464 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.498433 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q"] Sep 07 03:00:15.501945 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.501921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.504510 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.504478 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 07 03:00:15.504663 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.504522 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 07 03:00:15.505413 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.505386 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 03:00:15.505540 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.505447 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-t8j7t\"" Sep 07 03:00:15.505540 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.505483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 03:00:15.520889 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.520819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q"] Sep 07 03:00:15.623575 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.623531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2krl\" (UniqueName: \"kubernetes.io/projected/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kube-api-access-q2krl\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.623575 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.623587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.623818 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.623606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4163fec6-55f2-4e9f-b6d4-81db55b13caa-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.724668 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.724624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2krl\" (UniqueName: \"kubernetes.io/projected/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kube-api-access-q2krl\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.724853 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.724683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.724853 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.724708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4163fec6-55f2-4e9f-b6d4-81db55b13caa-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.725446 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.725422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.727255 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.727235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4163fec6-55f2-4e9f-b6d4-81db55b13caa-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.732684 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.732652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2krl\" (UniqueName: \"kubernetes.io/projected/4163fec6-55f2-4e9f-b6d4-81db55b13caa-kube-api-access-q2krl\") pod \"kubeflow-trainer-controller-manager-7f9b886978-tqt9q\" (UID: \"4163fec6-55f2-4e9f-b6d4-81db55b13caa\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:15.813172 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:15.813130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:16.080230 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:16.080157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q"] Sep 07 03:00:16.083088 ip-10-0-133-123 kubenswrapper[2564]: W0907 03:00:16.083063 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4163fec6_55f2_4e9f_b6d4_81db55b13caa.slice/crio-264407670c4c6a1b322d28a7ab2390a332211a4c059fd1efd9d1ad75f45f3ddb WatchSource:0}: Error finding container 264407670c4c6a1b322d28a7ab2390a332211a4c059fd1efd9d1ad75f45f3ddb: Status 404 returned error can't find the container with id 264407670c4c6a1b322d28a7ab2390a332211a4c059fd1efd9d1ad75f45f3ddb Sep 07 03:00:16.085373 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:16.085357 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 03:00:16.977675 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:16.977643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" event={"ID":"4163fec6-55f2-4e9f-b6d4-81db55b13caa","Type":"ContainerStarted","Data":"264407670c4c6a1b322d28a7ab2390a332211a4c059fd1efd9d1ad75f45f3ddb"} Sep 07 03:00:18.986919 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:18.986880 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" event={"ID":"4163fec6-55f2-4e9f-b6d4-81db55b13caa","Type":"ContainerStarted","Data":"282bfe3adc07261f98dd9aa38b3e5f4f36100626340f5b9b4d9ff618977ae903"} Sep 07 03:00:18.987364 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:18.986932 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:19.002346 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:19.002298 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" podStartSLOduration=2.0995644 podStartE2EDuration="4.002282205s" totalImagesPullingTime="1.902717805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:00:19.000122832 +0000 UTC m=+336.915944709" watchObservedRunningTime="2026-09-07 03:00:19.002282205 +0000 UTC m=+336.918104056" Sep 07 03:00:21.120944 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.120905 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bbf49d45-7ccmz"] Sep 07 03:00:21.126250 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.126225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.135613 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.135586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bbf49d45-7ccmz"] Sep 07 03:00:21.272214 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsskd\" (UniqueName: \"kubernetes.io/projected/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-kube-api-access-wsskd\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-service-ca\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-oauth-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-trusted-ca-bundle\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.272400 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.272395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-oauth-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373505 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-trusted-ca-bundle\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373505 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-oauth-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373505 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsskd\" (UniqueName: \"kubernetes.io/projected/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-kube-api-access-wsskd\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373759 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-service-ca\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373759 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-oauth-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373759 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.373759 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.373722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.374406 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.374352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-oauth-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.374528 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.374364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-service-ca\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.374528 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.374491 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.374528 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.374509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-trusted-ca-bundle\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.376483 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.376462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-serving-cert\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.376599 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.376578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-console-oauth-config\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.381822 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.381799 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsskd\" (UniqueName: \"kubernetes.io/projected/cfa062f7-5b3c-48d6-aac3-686a1d5bb21c-kube-api-access-wsskd\") pod \"console-67bbf49d45-7ccmz\" (UID: \"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c\") " pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.436140 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.436111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:21.706581 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.706556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bbf49d45-7ccmz"] Sep 07 03:00:21.708877 ip-10-0-133-123 kubenswrapper[2564]: W0907 03:00:21.708846 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa062f7_5b3c_48d6_aac3_686a1d5bb21c.slice/crio-6dae5a1b05bcd524f3d2e69872cdebef9ea807a1b53c701cfb6e7b8c333e7902 WatchSource:0}: Error finding container 6dae5a1b05bcd524f3d2e69872cdebef9ea807a1b53c701cfb6e7b8c333e7902: Status 404 returned error can't find the container with id 6dae5a1b05bcd524f3d2e69872cdebef9ea807a1b53c701cfb6e7b8c333e7902 Sep 07 03:00:22.000057 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:21.999953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bbf49d45-7ccmz" event={"ID":"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c","Type":"ContainerStarted","Data":"f61fce39f223bca9612aba9de7da6cccdaf2745922d5bd85834deb9659cfe733"} Sep 07 03:00:22.000057 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:22.000015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bbf49d45-7ccmz" event={"ID":"cfa062f7-5b3c-48d6-aac3-686a1d5bb21c","Type":"ContainerStarted","Data":"6dae5a1b05bcd524f3d2e69872cdebef9ea807a1b53c701cfb6e7b8c333e7902"} Sep 07 03:00:22.018537 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:22.018485 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67bbf49d45-7ccmz" podStartSLOduration=1.018465267 podStartE2EDuration="1.018465267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:00:22.017324956 +0000 UTC m=+339.933146848" watchObservedRunningTime="2026-09-07 03:00:22.018465267 +0000 UTC m=+339.934287121" Sep 07 03:00:31.437065 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:31.437021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:31.437709 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:31.437344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:31.443744 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:31.443711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:32.045475 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:32.045439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67bbf49d45-7ccmz" Sep 07 03:00:32.090565 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:32.090528 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 03:00:34.996004 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:34.995917 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-tqt9q" Sep 07 03:00:53.723513 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:53.723477 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 03:00:53.724007 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:53.723678 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" podUID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" containerName="manager" containerID="cri-o://677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958" gracePeriod=10 Sep 07 03:00:53.982218 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:53.982145 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 03:00:54.054575 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.054542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsmqr\" (UniqueName: \"kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr\") pod \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " Sep 07 03:00:54.054730 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.054588 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work\") pod \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " Sep 07 03:00:54.054730 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.054641 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs\") pod \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " Sep 07 03:00:54.054730 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.054709 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp\") pod \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\" (UID: \"75d3ad24-45ae-4b98-923f-3bf77b5204e5\") " Sep 07 03:00:54.055124 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.055086 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp" (OuterVolumeSpecName: "tmp") pod "75d3ad24-45ae-4b98-923f-3bf77b5204e5" (UID: "75d3ad24-45ae-4b98-923f-3bf77b5204e5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 03:00:54.056808 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.056772 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "75d3ad24-45ae-4b98-923f-3bf77b5204e5" (UID: "75d3ad24-45ae-4b98-923f-3bf77b5204e5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 03:00:54.056908 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.056826 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr" (OuterVolumeSpecName: "kube-api-access-jsmqr") pod "75d3ad24-45ae-4b98-923f-3bf77b5204e5" (UID: "75d3ad24-45ae-4b98-923f-3bf77b5204e5"). InnerVolumeSpecName "kube-api-access-jsmqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 03:00:54.057342 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.057304 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "75d3ad24-45ae-4b98-923f-3bf77b5204e5" (UID: "75d3ad24-45ae-4b98-923f-3bf77b5204e5"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 03:00:54.137131 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.137095 2564 generic.go:356] "Generic (PLEG): container finished" podID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" containerID="677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958" exitCode=0 Sep 07 03:00:54.137294 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.137154 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" Sep 07 03:00:54.137294 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.137172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" event={"ID":"75d3ad24-45ae-4b98-923f-3bf77b5204e5","Type":"ContainerDied","Data":"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958"} Sep 07 03:00:54.137294 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.137264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f" event={"ID":"75d3ad24-45ae-4b98-923f-3bf77b5204e5","Type":"ContainerDied","Data":"c32c4bb55aee232799f7c8a46f625290ce42d44b00b43008df8607910525d949"} Sep 07 03:00:54.137294 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.137293 2564 scope.go:117] "RemoveContainer" containerID="677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958" Sep 07 03:00:54.146264 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.146246 2564 scope.go:117] "RemoveContainer" containerID="677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958" Sep 07 03:00:54.146548 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:00:54.146529 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958\": container with ID starting with 677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958 not found: ID does not exist" containerID="677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958" Sep 07 03:00:54.146593 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.146555 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958"} err="failed to get container status \"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958\": rpc error: code = NotFound desc = could not find container \"677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958\": container with ID starting with 677ec218d2f6b0ca88052d44650d88b7ae01bd508740477067b6be5483bfb958 not found: ID does not exist" Sep 07 03:00:54.156305 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.156273 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsmqr\" (UniqueName: \"kubernetes.io/projected/75d3ad24-45ae-4b98-923f-3bf77b5204e5-kube-api-access-jsmqr\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:54.156305 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.156306 2564 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-manifests-work\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:54.156514 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.156321 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75d3ad24-45ae-4b98-923f-3bf77b5204e5-metrics-certs\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:54.156514 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.156346 2564 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75d3ad24-45ae-4b98-923f-3bf77b5204e5-tmp\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:54.157833 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.157814 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 03:00:54.161777 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.161746 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-668cdd7dcf-7rp6f"] Sep 07 03:00:54.507833 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:54.507797 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" path="/var/lib/kubelet/pods/75d3ad24-45ae-4b98-923f-3bf77b5204e5/volumes" Sep 07 03:00:57.111702 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.111657 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f5c474495-5p5vc" podUID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" containerName="console" containerID="cri-o://6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7" gracePeriod=15 Sep 07 03:00:57.356656 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.356628 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 03:00:57.487035 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.486902 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487035 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.486980 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487035 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487026 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487342 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487342 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487072 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487342 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487342 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487261 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hbc7\" (UniqueName: \"kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7\") pod \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\" (UID: \"61beaa06-11ee-43e7-a008-cb5fc78a42bc\") " Sep 07 03:00:57.487540 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487349 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 03:00:57.487540 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487497 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config" (OuterVolumeSpecName: "console-config") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 03:00:57.487540 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487522 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 03:00:57.487695 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487538 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 03:00:57.487695 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487633 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-service-ca\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.487695 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487651 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.487695 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487665 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-oauth-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.487695 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.487679 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61beaa06-11ee-43e7-a008-cb5fc78a42bc-trusted-ca-bundle\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.489444 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.489420 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 03:00:57.489444 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.489434 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7" (OuterVolumeSpecName: "kube-api-access-7hbc7") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "kube-api-access-7hbc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 03:00:57.489548 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.489437 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61beaa06-11ee-43e7-a008-cb5fc78a42bc" (UID: "61beaa06-11ee-43e7-a008-cb5fc78a42bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 03:00:57.589513 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.589484 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hbc7\" (UniqueName: \"kubernetes.io/projected/61beaa06-11ee-43e7-a008-cb5fc78a42bc-kube-api-access-7hbc7\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.589513 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.589508 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-oauth-config\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:57.589513 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:57.589523 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61beaa06-11ee-43e7-a008-cb5fc78a42bc-console-serving-cert\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:00:58.155528 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.155491 2564 generic.go:356] "Generic (PLEG): container finished" podID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" containerID="6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7" exitCode=0 Sep 07 03:00:58.155528 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.155530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c474495-5p5vc" event={"ID":"61beaa06-11ee-43e7-a008-cb5fc78a42bc","Type":"ContainerDied","Data":"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7"} Sep 07 03:00:58.156092 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.155541 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c474495-5p5vc" Sep 07 03:00:58.156092 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.155564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c474495-5p5vc" event={"ID":"61beaa06-11ee-43e7-a008-cb5fc78a42bc","Type":"ContainerDied","Data":"cf09d0180f3d68badbe44a03789e74544cc1699bca640c9f600d15637609bcee"} Sep 07 03:00:58.156092 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.155584 2564 scope.go:117] "RemoveContainer" containerID="6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7" Sep 07 03:00:58.163542 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.163526 2564 scope.go:117] "RemoveContainer" containerID="6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7" Sep 07 03:00:58.163794 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:00:58.163771 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7\": container with ID starting with 6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7 not found: ID does not exist" containerID="6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7" Sep 07 03:00:58.163890 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.163799 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7"} err="failed to get container status \"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7\": rpc error: code = NotFound desc = could not find container \"6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7\": container with ID starting with 6deead505a04362b6f17f73365e2c87965542d8b79ea4332c1b7d58e4f3c45a7 not found: ID does not exist" Sep 07 03:00:58.175782 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.175762 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 03:00:58.178841 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.178822 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5c474495-5p5vc"] Sep 07 03:00:58.508066 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:00:58.507943 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" path="/var/lib/kubelet/pods/61beaa06-11ee-43e7-a008-cb5fc78a42bc/volumes" Sep 07 03:06:11.844146 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844109 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ht6rb/must-gather-rr8k6"] Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844442 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" containerName="manager" Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844455 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" containerName="manager" Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844471 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" containerName="console" Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844476 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" containerName="console" Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844523 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="61beaa06-11ee-43e7-a008-cb5fc78a42bc" containerName="console" Sep 07 03:06:11.844646 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.844535 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d3ad24-45ae-4b98-923f-3bf77b5204e5" containerName="manager" Sep 07 03:06:11.847254 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.847235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:11.849881 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.849861 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ht6rb\"/\"kube-root-ca.crt\"" Sep 07 03:06:11.850003 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.849897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ht6rb\"/\"openshift-service-ca.crt\"" Sep 07 03:06:11.850786 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.850767 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ht6rb\"/\"default-dockercfg-sn8mr\"" Sep 07 03:06:11.870324 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.870296 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ht6rb/must-gather-rr8k6"] Sep 07 03:06:11.972734 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.972705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:11.972836 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:11.972814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28jm\" (UniqueName: \"kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.073112 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.073093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k28jm\" (UniqueName: \"kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.073200 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.073126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.073405 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.073389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.082922 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.082896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28jm\" (UniqueName: \"kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm\") pod \"must-gather-rr8k6\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.155919 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.155872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:06:12.430566 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.430541 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ht6rb/must-gather-rr8k6"] Sep 07 03:06:12.433112 ip-10-0-133-123 kubenswrapper[2564]: W0907 03:06:12.433085 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a8f6aca_e87d_4b92_b4cb_76e9ae977042.slice/crio-298daced881a5115db15a6555cf9ea67edbc209526c207d4fb9cd1bdb428370a WatchSource:0}: Error finding container 298daced881a5115db15a6555cf9ea67edbc209526c207d4fb9cd1bdb428370a: Status 404 returned error can't find the container with id 298daced881a5115db15a6555cf9ea67edbc209526c207d4fb9cd1bdb428370a Sep 07 03:06:12.435197 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:12.435182 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 03:06:13.394816 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:13.394775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" event={"ID":"2a8f6aca-e87d-4b92-b4cb-76e9ae977042","Type":"ContainerStarted","Data":"298daced881a5115db15a6555cf9ea67edbc209526c207d4fb9cd1bdb428370a"} Sep 07 03:06:19.429793 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:19.429750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" event={"ID":"2a8f6aca-e87d-4b92-b4cb-76e9ae977042","Type":"ContainerStarted","Data":"439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162"} Sep 07 03:06:19.430266 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:19.429807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" event={"ID":"2a8f6aca-e87d-4b92-b4cb-76e9ae977042","Type":"ContainerStarted","Data":"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa"} Sep 07 03:06:27.976896 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:27.976864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-tqt9q_4163fec6-55f2-4e9f-b6d4-81db55b13caa/manager/0.log" Sep 07 03:06:28.473997 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:28.473973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-tqt9q_4163fec6-55f2-4e9f-b6d4-81db55b13caa/manager/0.log" Sep 07 03:06:28.943499 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:06:28.943466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-tqt9q_4163fec6-55f2-4e9f-b6d4-81db55b13caa/manager/0.log" Sep 07 03:07:04.632050 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:04.632014 2564 generic.go:356] "Generic (PLEG): container finished" podID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerID="28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa" exitCode=0 Sep 07 03:07:04.632487 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:04.632088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" event={"ID":"2a8f6aca-e87d-4b92-b4cb-76e9ae977042","Type":"ContainerDied","Data":"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa"} Sep 07 03:07:04.632487 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:04.632366 2564 scope.go:117] "RemoveContainer" containerID="28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa" Sep 07 03:07:04.691737 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:04.691715 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ht6rb_must-gather-rr8k6_2a8f6aca-e87d-4b92-b4cb-76e9ae977042/gather/0.log" Sep 07 03:07:05.187029 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.187002 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2w8n7/must-gather-dw2rv"] Sep 07 03:07:05.189292 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.189277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.191953 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.191933 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2w8n7\"/\"kube-root-ca.crt\"" Sep 07 03:07:05.192784 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.192765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2w8n7\"/\"default-dockercfg-2kw6n\"" Sep 07 03:07:05.192869 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.192790 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2w8n7\"/\"openshift-service-ca.crt\"" Sep 07 03:07:05.197490 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.197470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2w8n7/must-gather-dw2rv"] Sep 07 03:07:05.328941 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.328914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2cm\" (UniqueName: \"kubernetes.io/projected/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-kube-api-access-rc2cm\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.329062 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.328983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-must-gather-output\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.430064 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.430024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-must-gather-output\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.430184 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.430104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2cm\" (UniqueName: \"kubernetes.io/projected/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-kube-api-access-rc2cm\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.430426 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.430403 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-must-gather-output\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.438589 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.438536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2cm\" (UniqueName: \"kubernetes.io/projected/05e73b49-7828-4d9f-8276-4ec2dbb0ba3b-kube-api-access-rc2cm\") pod \"must-gather-dw2rv\" (UID: \"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b\") " pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.498632 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.498608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" Sep 07 03:07:05.784266 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:05.784217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2w8n7/must-gather-dw2rv"] Sep 07 03:07:05.786726 ip-10-0-133-123 kubenswrapper[2564]: W0907 03:07:05.786699 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05e73b49_7828_4d9f_8276_4ec2dbb0ba3b.slice/crio-76a94d091ae1ee03aa06f734869b2f2bf33fa2fd8e4eb9c429098c7b5aa141a7 WatchSource:0}: Error finding container 76a94d091ae1ee03aa06f734869b2f2bf33fa2fd8e4eb9c429098c7b5aa141a7: Status 404 returned error can't find the container with id 76a94d091ae1ee03aa06f734869b2f2bf33fa2fd8e4eb9c429098c7b5aa141a7 Sep 07 03:07:06.642888 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:06.642853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" event={"ID":"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b","Type":"ContainerStarted","Data":"76a94d091ae1ee03aa06f734869b2f2bf33fa2fd8e4eb9c429098c7b5aa141a7"} Sep 07 03:07:07.649131 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:07.649091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" event={"ID":"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b","Type":"ContainerStarted","Data":"679ada4a5c124c6a3bb965e634407a9490e9faf506a27d04c945d71f8a222d10"} Sep 07 03:07:07.649505 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:07.649142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" event={"ID":"05e73b49-7828-4d9f-8276-4ec2dbb0ba3b","Type":"ContainerStarted","Data":"460bcf33f198119053bcefe65b68e96214f10852cd6145efba8aad684c96a776"} Sep 07 03:07:07.664389 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:07.664335 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2w8n7/must-gather-dw2rv" podStartSLOduration=1.842487537 podStartE2EDuration="2.664315023s" totalImagesPullingTime="821.827486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:07:07.663891607 +0000 UTC m=+745.579713461" watchObservedRunningTime="2026-09-07 03:07:07.664315023 +0000 UTC m=+745.580136889" Sep 07 03:07:08.007599 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:08.007507 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zg8r5_176807a7-4091-4662-a33e-0232f384d1f0/global-pull-secret-syncer/0.log" Sep 07 03:07:08.068647 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:08.068615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7vfxg_7c4420bc-a4c6-4f1c-9678-916ed8bb910b/konnectivity-agent/0.log" Sep 07 03:07:08.143981 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:08.143934 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-123.ec2.internal_99eef7e7e59f3a6a1efe5e3f2b7b402f/haproxy/0.log" Sep 07 03:07:10.031388 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.031328 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ht6rb/must-gather-rr8k6"] Sep 07 03:07:10.031944 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.031624 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="copy" containerID="cri-o://439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162" gracePeriod=2 Sep 07 03:07:10.033930 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:07:10.033884 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rr8k6\" is forbidden: User \"system:node:ip-10-0-133-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ht6rb\": no relationship found between node 'ip-10-0-133-123.ec2.internal' and this object" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:07:10.035724 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.035695 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ht6rb/must-gather-rr8k6"] Sep 07 03:07:10.403948 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.403276 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ht6rb_must-gather-rr8k6_2a8f6aca-e87d-4b92-b4cb-76e9ae977042/copy/0.log" Sep 07 03:07:10.409906 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.409652 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:07:10.414631 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:07:10.414575 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rr8k6\" is forbidden: User \"system:node:ip-10-0-133-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ht6rb\": no relationship found between node 'ip-10-0-133-123.ec2.internal' and this object" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:07:10.488205 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.484193 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output\") pod \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " Sep 07 03:07:10.488205 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.484300 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k28jm\" (UniqueName: \"kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm\") pod \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\" (UID: \"2a8f6aca-e87d-4b92-b4cb-76e9ae977042\") " Sep 07 03:07:10.488205 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.486622 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2a8f6aca-e87d-4b92-b4cb-76e9ae977042" (UID: "2a8f6aca-e87d-4b92-b4cb-76e9ae977042"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 03:07:10.488205 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.487277 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm" (OuterVolumeSpecName: "kube-api-access-k28jm") pod "2a8f6aca-e87d-4b92-b4cb-76e9ae977042" (UID: "2a8f6aca-e87d-4b92-b4cb-76e9ae977042"). InnerVolumeSpecName "kube-api-access-k28jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 03:07:10.511080 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.511043 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" path="/var/lib/kubelet/pods/2a8f6aca-e87d-4b92-b4cb-76e9ae977042/volumes" Sep 07 03:07:10.585763 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.585724 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k28jm\" (UniqueName: \"kubernetes.io/projected/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-kube-api-access-k28jm\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:07:10.585763 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.585761 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2a8f6aca-e87d-4b92-b4cb-76e9ae977042-must-gather-output\") on node \"ip-10-0-133-123.ec2.internal\" DevicePath \"\"" Sep 07 03:07:10.667874 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.667791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ht6rb_must-gather-rr8k6_2a8f6aca-e87d-4b92-b4cb-76e9ae977042/copy/0.log" Sep 07 03:07:10.668310 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.668273 2564 generic.go:356] "Generic (PLEG): container finished" podID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerID="439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162" exitCode=143 Sep 07 03:07:10.668424 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.668360 2564 scope.go:117] "RemoveContainer" containerID="439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162" Sep 07 03:07:10.668548 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.668529 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ht6rb/must-gather-rr8k6" Sep 07 03:07:10.687317 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.685415 2564 scope.go:117] "RemoveContainer" containerID="28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa" Sep 07 03:07:10.718208 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.718127 2564 scope.go:117] "RemoveContainer" containerID="439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162" Sep 07 03:07:10.719178 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:07:10.718623 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162\": container with ID starting with 439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162 not found: ID does not exist" containerID="439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162" Sep 07 03:07:10.719178 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.718663 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162"} err="failed to get container status \"439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162\": rpc error: code = NotFound desc = could not find container \"439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162\": container with ID starting with 439baebb29c84e40af905cedeb08fe89b2a12bcc70e772adc5b84aa47e624162 not found: ID does not exist" Sep 07 03:07:10.719178 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.718690 2564 scope.go:117] "RemoveContainer" containerID="28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa" Sep 07 03:07:10.719178 ip-10-0-133-123 kubenswrapper[2564]: E0907 03:07:10.719056 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa\": container with ID starting with 28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa not found: ID does not exist" containerID="28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa" Sep 07 03:07:10.719178 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:10.719086 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa"} err="failed to get container status \"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa\": rpc error: code = NotFound desc = could not find container \"28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa\": container with ID starting with 28e296b138c1111ff4d9f5df7bf1e2957b82efc8132800026e754b3cfbbbe5fa not found: ID does not exist" Sep 07 03:07:11.401264 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.401195 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/alertmanager/0.log" Sep 07 03:07:11.432709 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.432681 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/config-reloader/0.log" Sep 07 03:07:11.468980 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.468942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/kube-rbac-proxy-web/0.log" Sep 07 03:07:11.500602 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.500520 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/kube-rbac-proxy/0.log" Sep 07 03:07:11.538053 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.538011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/kube-rbac-proxy-metric/0.log" Sep 07 03:07:11.567195 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.567172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/prom-label-proxy/0.log" Sep 07 03:07:11.599868 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.599839 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9a0f42e-b790-448d-b173-4d0a74edd270/init-config-reloader/0.log" Sep 07 03:07:11.691427 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.691351 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-q29sp_8990f5ee-41ca-4443-b106-7361914f9d50/kube-state-metrics/0.log" Sep 07 03:07:11.733048 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.733014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-q29sp_8990f5ee-41ca-4443-b106-7361914f9d50/kube-rbac-proxy-main/0.log" Sep 07 03:07:11.768408 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.768385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-q29sp_8990f5ee-41ca-4443-b106-7361914f9d50/kube-rbac-proxy-self/0.log" Sep 07 03:07:11.868569 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.868542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tpdw_8bc8c959-b1e0-4ae8-8d07-5e222ad9339b/node-exporter/0.log" Sep 07 03:07:11.895662 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.895636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tpdw_8bc8c959-b1e0-4ae8-8d07-5e222ad9339b/kube-rbac-proxy/0.log" Sep 07 03:07:11.924920 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:11.922455 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tpdw_8bc8c959-b1e0-4ae8-8d07-5e222ad9339b/init-textfile/0.log" Sep 07 03:07:12.127339 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.127309 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8m7z_af3f07f5-d9b5-4d46-afac-5b787f88559a/kube-rbac-proxy-main/0.log" Sep 07 03:07:12.151987 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.151909 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8m7z_af3f07f5-d9b5-4d46-afac-5b787f88559a/kube-rbac-proxy-self/0.log" Sep 07 03:07:12.176881 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.176854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8m7z_af3f07f5-d9b5-4d46-afac-5b787f88559a/openshift-state-metrics/0.log" Sep 07 03:07:12.219038 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.219006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/prometheus/0.log" Sep 07 03:07:12.242527 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.242496 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/config-reloader/0.log" Sep 07 03:07:12.266691 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.266654 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/thanos-sidecar/0.log" Sep 07 03:07:12.293774 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.293744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/kube-rbac-proxy-web/0.log" Sep 07 03:07:12.314580 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.314546 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/kube-rbac-proxy/0.log" Sep 07 03:07:12.340136 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.340111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/kube-rbac-proxy-thanos/0.log" Sep 07 03:07:12.369791 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.369766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c45f2338-7d44-437e-909e-ffff6399e112/init-config-reloader/0.log" Sep 07 03:07:12.408933 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.408851 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-t674k_0e5a148d-2746-4b5b-9463-dda672b1360a/prometheus-operator/0.log" Sep 07 03:07:12.431251 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:12.431222 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-t674k_0e5a148d-2746-4b5b-9463-dda672b1360a/kube-rbac-proxy/0.log" Sep 07 03:07:14.918031 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:14.918001 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bbf49d45-7ccmz_cfa062f7-5b3c-48d6-aac3-686a1d5bb21c/console/0.log" Sep 07 03:07:15.682904 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.682872 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z"] Sep 07 03:07:15.683221 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683200 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="copy" Sep 07 03:07:15.683381 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683367 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="copy" Sep 07 03:07:15.683513 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683499 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="gather" Sep 07 03:07:15.683614 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683602 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="gather" Sep 07 03:07:15.683814 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683800 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="gather" Sep 07 03:07:15.683919 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.683908 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8f6aca-e87d-4b92-b4cb-76e9ae977042" containerName="copy" Sep 07 03:07:15.689627 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.689598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.695827 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.695794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z"] Sep 07 03:07:15.833108 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.833070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-proc\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.833293 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.833134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-lib-modules\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.833293 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.833242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5xx\" (UniqueName: \"kubernetes.io/projected/62dc1128-c25f-4784-a651-0b3f608dedef-kube-api-access-jf5xx\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.833416 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.833357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-sys\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.833416 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.833383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-podres\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.934687 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-lib-modules\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.934687 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5xx\" (UniqueName: \"kubernetes.io/projected/62dc1128-c25f-4784-a651-0b3f608dedef-kube-api-access-jf5xx\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935219 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-sys\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935219 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-podres\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935219 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-proc\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935219 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-lib-modules\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935219 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934911 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-proc\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935488 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.934936 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-podres\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.935547 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.935515 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dc1128-c25f-4784-a651-0b3f608dedef-sys\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:15.944780 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:15.944755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5xx\" (UniqueName: \"kubernetes.io/projected/62dc1128-c25f-4784-a651-0b3f608dedef-kube-api-access-jf5xx\") pod \"perf-node-gather-daemonset-xhn8z\" (UID: \"62dc1128-c25f-4784-a651-0b3f608dedef\") " pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:16.005659 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.005623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:16.295576 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.295497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z"] Sep 07 03:07:16.409729 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.409706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rl5zs_013ad0ec-85be-4acd-939a-ca3d2f827980/dns/0.log" Sep 07 03:07:16.436340 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.436322 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rl5zs_013ad0ec-85be-4acd-939a-ca3d2f827980/kube-rbac-proxy/0.log" Sep 07 03:07:16.527169 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.527144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnt4k_96579e00-d7ab-45ff-83ad-709af63cba72/dns-node-resolver/0.log" Sep 07 03:07:16.704636 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.704562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" event={"ID":"62dc1128-c25f-4784-a651-0b3f608dedef","Type":"ContainerStarted","Data":"1c765a4bd792fed5ba2c727a793f9fd5e17db265cb0a1b795452702bf65eac3a"} Sep 07 03:07:16.704636 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.704609 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" event={"ID":"62dc1128-c25f-4784-a651-0b3f608dedef","Type":"ContainerStarted","Data":"3c3735861e8ead608ea15c61d37901aafaf6ccd04ac25d5e8da61cbe21ffe3cc"} Sep 07 03:07:16.704636 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.704639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:16.953073 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:16.953032 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52r7c_55e0402f-af8f-4f79-9c32-8c1d82b158d7/node-ca/0.log" Sep 07 03:07:18.053832 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:18.053803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lrf72_16790e2e-7d36-4174-93f2-4bded59a314d/serve-healthcheck-canary/0.log" Sep 07 03:07:18.412655 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:18.412596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2pql_a7065a7c-b577-438e-94c7-d1f10c25f65d/kube-rbac-proxy/0.log" Sep 07 03:07:18.432551 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:18.432528 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2pql_a7065a7c-b577-438e-94c7-d1f10c25f65d/exporter/0.log" Sep 07 03:07:18.454504 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:18.454484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2pql_a7065a7c-b577-438e-94c7-d1f10c25f65d/extractor/0.log" Sep 07 03:07:20.167879 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:20.167846 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-csh9k_3f3e3180-ef39-488f-97c5-827372379825/jobset-operator/0.log" Sep 07 03:07:22.723183 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:22.723154 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" Sep 07 03:07:22.741722 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:22.741676 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2w8n7/perf-node-gather-daemonset-xhn8z" podStartSLOduration=7.741661307 podStartE2EDuration="7.741661307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:07:16.721718404 +0000 UTC m=+754.637540257" watchObservedRunningTime="2026-09-07 03:07:22.741661307 +0000 UTC m=+760.657483189" Sep 07 03:07:24.452302 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.452266 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2m84v_94030ba7-4360-4f4d-96d3-59015184c1f9/kube-multus/0.log" Sep 07 03:07:24.481611 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.481582 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/kube-multus-additional-cni-plugins/0.log" Sep 07 03:07:24.503796 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.503771 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/egress-router-binary-copy/0.log" Sep 07 03:07:24.526179 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.526138 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/cni-plugins/0.log" Sep 07 03:07:24.548759 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.548739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/bond-cni-plugin/0.log" Sep 07 03:07:24.575688 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.575616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/routeoverride-cni/0.log" Sep 07 03:07:24.596351 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.596326 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/whereabouts-cni-bincopy/0.log" Sep 07 03:07:24.617874 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:24.617844 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqgbd_ff18a6c7-f5f7-4ccb-a0a1-d4a97b4becf9/whereabouts-cni/0.log" Sep 07 03:07:25.041546 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.041510 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dbzt_bbff0fd2-b442-4c24-925e-fe58e963d82d/network-metrics-daemon/0.log" Sep 07 03:07:25.062217 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.062188 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dbzt_bbff0fd2-b442-4c24-925e-fe58e963d82d/kube-rbac-proxy/0.log" Sep 07 03:07:25.878596 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.878570 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/ovn-controller/0.log" Sep 07 03:07:25.896514 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.896488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/ovn-acl-logging/0.log" Sep 07 03:07:25.917337 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.917310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/kube-rbac-proxy-node/0.log" Sep 07 03:07:25.938331 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.938311 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 03:07:25.959997 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.959976 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/northd/0.log" Sep 07 03:07:25.982626 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:25.982586 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/nbdb/0.log" Sep 07 03:07:26.004662 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:26.004634 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/sbdb/0.log" Sep 07 03:07:26.056983 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:26.056935 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5b78k_56dcda98-e80b-45e7-a9e2-deab6740492e/ovnkube-controller/0.log" Sep 07 03:07:27.423719 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:27.423693 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pv4jb_1b25cbbe-22c0-467a-95fb-eba506f1622b/network-check-target-container/0.log" Sep 07 03:07:28.291179 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:28.291153 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-c6stn_398319e2-50b3-411e-a129-46a60cb2d719/iptables-alerter/0.log" Sep 07 03:07:28.942860 ip-10-0-133-123 kubenswrapper[2564]: I0907 03:07:28.942830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tzrkp_a6843702-0675-4838-a580-8f550cdcf0f2/tuned/0.log"