Jul 27 11:43:48.807799 ip-10-0-138-65 systemd[1]: Starting Kubernetes Kubelet... Jul 27 11:43:49.183867 ip-10-0-138-65 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 11:43:49.183867 ip-10-0-138-65 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 11:43:49.183867 ip-10-0-138-65 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 11:43:49.183867 ip-10-0-138-65 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 11:43:49.183867 ip-10-0-138-65 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 11:43:49.184908 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.184789 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 11:43:49.189211 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189193 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.189211 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189211 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189215 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189219 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189222 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189225 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189228 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189231 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189234 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189237 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189240 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189242 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189245 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189248 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189250 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189253 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189256 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189259 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189262 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189264 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.189282 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189267 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189270 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189272 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189275 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189277 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189280 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189285 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189288 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189291 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189294 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189297 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189299 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189302 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189305 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189307 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189310 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189312 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189315 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189317 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189320 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.189793 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189332 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189335 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189338 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189340 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189343 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189346 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189349 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189351 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189354 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189356 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189359 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189362 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189364 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189367 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189370 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189373 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189376 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189379 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189382 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189384 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.190280 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189388 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189390 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189393 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189395 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189398 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189400 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189403 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189406 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189408 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189411 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189413 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189416 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189418 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189421 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189423 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189427 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189430 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189434 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189437 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189440 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.190783 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189442 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189445 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189448 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189452 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189457 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189460 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189465 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189469 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189472 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189475 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189478 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189481 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189484 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189487 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189489 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189492 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189494 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189497 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.189500 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190369 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.191271 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190381 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190385 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190388 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190393 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190398 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190403 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190406 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190409 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190412 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190415 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190418 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190420 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190423 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190425 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190427 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190430 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190433 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190435 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190438 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.191790 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190441 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190444 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190452 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190455 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190457 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190460 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190462 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190465 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190467 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190470 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190472 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190475 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190478 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190481 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190484 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190486 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190489 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190491 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190494 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.192310 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190496 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190499 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190502 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190505 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190507 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190510 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190512 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190532 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190535 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190537 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190540 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190543 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190546 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190548 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190551 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190554 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190562 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190565 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190568 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190570 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.192894 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190573 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190575 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190578 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190581 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190583 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190586 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190589 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190591 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190594 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190597 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190599 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190601 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190604 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190606 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190610 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190613 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190615 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190618 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190620 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190623 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.193387 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190625 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190628 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190630 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190633 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190635 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190638 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190640 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190643 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190645 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190655 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190659 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190661 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190664 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190667 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190670 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190673 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190676 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190678 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190681 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.193900 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.190684 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191152 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191158 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191161 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191164 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191166 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191169 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191172 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191174 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191177 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191180 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191183 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191185 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191188 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191190 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191193 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191195 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191198 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191201 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191203 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.194362 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191205 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191208 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191217 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191220 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191222 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191225 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191227 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191230 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191232 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191237 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191241 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191244 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191247 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191250 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191253 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191256 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191259 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191261 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191264 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.194864 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191266 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191269 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191272 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191275 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191277 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191280 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191283 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191285 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191288 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191291 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191294 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191296 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191299 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191301 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191304 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191306 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191314 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191317 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191319 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191322 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.195335 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191324 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191329 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191331 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191334 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191339 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191342 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191345 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191348 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191360 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191364 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191366 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191369 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191371 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191374 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191377 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191379 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191382 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191384 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191387 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.195862 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191389 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191392 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191395 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191399 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191402 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191404 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191407 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191409 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191412 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191414 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191423 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191426 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191429 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191431 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191433 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191436 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191439 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191441 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191444 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191447 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.196317 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191449 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.191452 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191529 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191536 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191550 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191555 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191559 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191562 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191566 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191570 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191573 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191576 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191580 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191583 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191586 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191589 2583 flags.go:64] FLAG: --cgroup-root="" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191593 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191596 2583 flags.go:64] FLAG: --client-ca-file="" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191599 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191602 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191608 2583 flags.go:64] FLAG: --cluster-domain="" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191611 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191614 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191622 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 11:43:49.196829 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191626 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191630 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191633 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191636 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191639 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191643 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191646 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191649 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191652 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191655 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191659 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191662 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191665 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191668 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191671 2583 flags.go:64] FLAG: --enable-server="true" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191674 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191681 2583 flags.go:64] FLAG: --event-burst="100" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191684 2583 flags.go:64] FLAG: --event-qps="50" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191686 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191690 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191692 2583 flags.go:64] FLAG: --eviction-hard="" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191696 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191699 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191702 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191705 2583 flags.go:64] FLAG: --eviction-soft="" Jul 27 11:43:49.197401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191708 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191711 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191714 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191716 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191720 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191723 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191726 2583 flags.go:64] FLAG: --feature-gates="" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191737 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191741 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191744 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191747 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191751 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191754 2583 flags.go:64] FLAG: --help="false" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191757 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-65.ec2.internal" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191760 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191763 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191766 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191769 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191772 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191776 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191778 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191781 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191784 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 11:43:49.198044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191787 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191790 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191793 2583 flags.go:64] FLAG: --kube-reserved="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191796 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191799 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191802 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191805 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191808 2583 flags.go:64] FLAG: --lock-file="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191811 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191814 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191817 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191822 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191825 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191828 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191830 2583 flags.go:64] FLAG: --logging-format="text" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191833 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191837 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191848 2583 flags.go:64] FLAG: --manifest-url="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191851 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191856 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191859 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191863 2583 flags.go:64] FLAG: --max-pods="110" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191866 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191869 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191872 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 11:43:49.198792 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191875 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191877 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191880 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191883 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191890 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191893 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191896 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191899 2583 flags.go:64] FLAG: --pod-cidr="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191902 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191907 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191910 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191913 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191916 2583 flags.go:64] FLAG: --port="10250" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191919 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191922 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-081355bc204d57ef5" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191925 2583 flags.go:64] FLAG: --qos-reserved="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191928 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191931 2583 flags.go:64] FLAG: --register-node="true" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191933 2583 flags.go:64] FLAG: --register-with-taints="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191937 2583 flags.go:64] FLAG: --registry-burst="10" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191940 2583 flags.go:64] FLAG: --registry-qps="5" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191943 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191946 2583 flags.go:64] FLAG: --reserved-memory="" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191952 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191955 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 11:43:49.199804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191963 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191966 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191969 2583 flags.go:64] FLAG: --runonce="false" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191973 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191976 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191979 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191982 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191985 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191988 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191991 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191994 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191997 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.191999 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192002 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192005 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192008 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192011 2583 flags.go:64] FLAG: --system-cgroups="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192014 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192020 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192022 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192025 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192037 2583 flags.go:64] FLAG: --tls-min-version="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192040 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192043 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192046 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 11:43:49.200651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192049 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192052 2583 flags.go:64] FLAG: --v="2" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192056 2583 flags.go:64] FLAG: --version="false" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192061 2583 flags.go:64] FLAG: --vmodule="" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192065 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.192069 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192220 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192224 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192234 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192237 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192240 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192243 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192245 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192248 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192250 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192254 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192256 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192259 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192262 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192264 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.201265 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192267 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192269 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192272 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192275 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192277 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192280 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192283 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192285 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192287 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192290 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192292 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192295 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192297 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192300 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192302 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192307 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192311 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192316 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192319 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192322 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.201804 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192324 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192332 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192335 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192337 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192342 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192345 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192348 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192350 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192353 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192357 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192361 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192365 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192368 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192370 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192373 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192376 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192379 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192382 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192384 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.202323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192387 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192390 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192392 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192395 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192398 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192400 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192403 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192405 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192410 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192412 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192416 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192419 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192421 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192424 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192426 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192434 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192437 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192440 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192442 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192444 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.202807 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192447 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192449 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192452 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192455 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192457 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192460 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192462 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192465 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192467 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192470 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192472 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192475 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192477 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192479 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192482 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192484 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192487 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192489 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192492 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192494 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.203304 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192498 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192501 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192504 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192507 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192509 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.192526 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.193043 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.201578 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.201596 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.201620 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.201627 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201692 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201697 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201701 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201704 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.203808 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201707 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201710 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201714 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201717 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201720 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201723 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201725 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201728 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201731 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201733 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201736 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201738 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201741 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201744 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201747 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201749 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201752 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201755 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201757 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201760 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201763 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.204192 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201766 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201769 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201771 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201774 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201777 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201780 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201782 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201785 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201788 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201790 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201793 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201797 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201801 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201805 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201808 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201811 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201814 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201817 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201820 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201823 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.204731 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201826 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201828 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201831 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201834 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201837 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201840 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201842 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201845 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201847 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201850 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201852 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201855 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201858 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201860 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201863 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201865 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201869 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201871 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201874 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.205247 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201876 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201879 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201882 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201884 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201887 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201889 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201892 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201895 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201897 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201899 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201902 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201905 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201907 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201910 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201913 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201921 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201924 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201926 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201929 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.205771 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201933 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201936 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201939 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201943 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201947 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201950 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201953 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201956 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201959 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201961 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201965 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201968 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201971 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201974 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201977 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.206259 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.201979 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.201985 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202111 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202117 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202120 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202123 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202126 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202129 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202131 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202134 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202136 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202139 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202141 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202144 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 11:43:49.206635 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202152 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202154 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202157 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202160 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202162 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202165 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202167 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202170 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202172 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202175 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202177 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202179 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202182 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202185 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202188 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202191 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202193 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202196 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202198 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202201 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 11:43:49.206981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202204 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202208 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202211 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202213 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202216 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202219 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202222 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202224 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202227 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202229 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202232 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202234 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202237 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202247 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202251 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202253 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202256 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202258 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202261 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202263 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 11:43:49.207478 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202266 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202268 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202271 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202274 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202276 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202278 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202281 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202284 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202286 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202289 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202291 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202294 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202296 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202299 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202301 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202304 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202306 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202309 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202311 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202313 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 11:43:49.207978 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202316 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202318 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202321 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202325 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202327 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202330 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202334 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202336 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202339 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202341 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202344 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202346 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202349 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202351 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202354 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202356 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202359 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202361 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202364 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202367 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 11:43:49.208489 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202369 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202372 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202374 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202377 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202380 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202382 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:49.202384 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.202389 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.202503 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.204595 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.205849 2583 server.go:1019] "Starting client certificate rotation" Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.205949 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.205979 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 11:43:49.208981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.208111 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 11:43:49.211118 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.211104 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 11:43:49.221653 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.221620 2583 log.go:25] "Validated CRI v1 runtime API" Jul 27 11:43:49.223779 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.223764 2583 log.go:25] "Validated CRI v1 image API" Jul 27 11:43:49.225640 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.225615 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 11:43:49.228102 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.228073 2583 fs.go:135] Filesystem UUIDs: map[5756ef8b-fdb7-4b45-bf21-de60c8892050:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 861d1bbe-eaee-4d04-8250-b61b1ca8ce4c:/dev/nvme0n1p3] Jul 27 11:43:49.228177 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.228100 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 11:43:49.232718 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.232690 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 11:43:49.234438 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.234323 2583 manager.go:216] Machine: {Timestamp:2026-07-27 11:43:49.233829656 +0000 UTC m=+0.315457235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100702 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b823d763f442a0e1ebfa49e090304 SystemUUID:ec2b823d-763f-442a-0e1e-bfa49e090304 BootID:2da261e9-5ae4-4049-8c11-7e7ea782e1e3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:25:24:8a:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:25:24:8a:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:8d:1a:74:77:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 11:43:49.234438 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.234426 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 11:43:49.234631 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.234558 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 11:43:49.237404 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.237376 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 11:43:49.237619 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.237409 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 11:43:49.238163 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.238151 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 11:43:49.238228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.238170 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 11:43:49.238228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.238180 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 11:43:49.238804 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.238791 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 11:43:49.239479 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.239467 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 11:43:49.242046 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242032 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 27 11:43:49.242181 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242170 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 11:43:49.242249 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242209 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 27 11:43:49.242249 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242223 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 11:43:49.242249 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242243 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 11:43:49.242375 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242275 2583 kubelet.go:398] "Adding apiserver pod source" Jul 27 11:43:49.242375 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242289 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 11:43:49.242678 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242665 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 11:43:49.242739 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.242687 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 11:43:49.244681 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.244666 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 11:43:49.246465 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.246442 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 11:43:49.246554 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.246481 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 11:43:49.248038 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248026 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248042 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248048 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248054 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248063 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248068 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248076 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248081 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 11:43:49.248085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248088 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 11:43:49.248309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248094 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 11:43:49.248309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248103 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 11:43:49.248309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248108 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 11:43:49.248309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248132 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 11:43:49.248309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.248137 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 11:43:49.250187 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.250165 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hqhj9" Jul 27 11:43:49.251396 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.251382 2583 server.go:1268] "Started kubelet" Jul 27 11:43:49.251645 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.251620 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-65.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 11:43:49.251713 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.251637 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 11:43:49.251713 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.251643 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 11:43:49.251713 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.251691 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 11:43:49.251856 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.251803 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 11:43:49.251856 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.251848 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 11:43:49.252327 ip-10-0-138-65 systemd[1]: Started Kubernetes Kubelet. Jul 27 11:43:49.254497 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.254482 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 27 11:43:49.255813 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.255796 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 11:43:49.257612 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.257589 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 11:43:49.257848 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.257832 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hqhj9" Jul 27 11:43:49.259635 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.258734 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-65.ec2.internal.18c622dbb0619f25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-65.ec2.internal,UID:ip-10-0-138-65.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-65.ec2.internal,},FirstTimestamp:2026-07-27 11:43:49.251350309 +0000 UTC m=+0.332977888,LastTimestamp:2026-07-27 11:43:49.251350309 +0000 UTC m=+0.332977888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-65.ec2.internal,}" Jul 27 11:43:49.262052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262034 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 11:43:49.262052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262041 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 11:43:49.262248 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.262226 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:49.262629 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262613 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 11:43:49.262629 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262616 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 11:43:49.262773 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262638 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 11:43:49.262773 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262729 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 27 11:43:49.262773 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262739 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 27 11:43:49.262913 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262863 2583 factory.go:55] Registering systemd factory Jul 27 11:43:49.262913 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.262878 2583 factory.go:223] Registration of the systemd container factory successfully Jul 27 11:43:49.263070 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263056 2583 factory.go:153] Registering CRI-O factory Jul 27 11:43:49.263129 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263074 2583 factory.go:223] Registration of the crio container factory successfully Jul 27 11:43:49.263181 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263138 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 11:43:49.263181 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263163 2583 factory.go:103] Registering Raw factory Jul 27 11:43:49.263181 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263178 2583 manager.go:1196] Started watching for new ooms in manager Jul 27 11:43:49.264934 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.263869 2583 manager.go:349] Starting recovery of all containers Jul 27 11:43:49.264934 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.264114 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 11:43:49.273842 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.273820 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:49.275738 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.275716 2583 manager.go:354] Recovery completed Jul 27 11:43:49.281576 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.281563 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:49.284630 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.284607 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:49.284705 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.284637 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:49.284705 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.284647 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:49.285203 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.285189 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 11:43:49.285203 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.285202 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 11:43:49.285294 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.285222 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 27 11:43:49.285294 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.285238 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:49.285991 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.285977 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:49.286044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.286025 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:49.286044 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.286036 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:49.287740 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.287727 2583 policy_none.go:49] "None policy: Start" Jul 27 11:43:49.287796 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.287744 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 11:43:49.287796 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.287756 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 11:43:49.289717 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.289705 2583 policy_none.go:47] "Start" Jul 27 11:43:49.325235 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325057 2583 manager.go:337] "Starting Device Plugin manager" Jul 27 11:43:49.325316 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.325262 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 11:43:49.325316 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325276 2583 server.go:87] "Starting device plugin registration server" Jul 27 11:43:49.325563 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325552 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 11:43:49.325622 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325567 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 11:43:49.325666 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325647 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 11:43:49.325752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325741 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 11:43:49.325800 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.325762 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 11:43:49.326252 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.326234 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 11:43:49.326312 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.326280 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:49.398242 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.398203 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 11:43:49.400316 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.399425 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 11:43:49.400316 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.399461 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 11:43:49.400316 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.399488 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 11:43:49.400316 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:49.399562 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 11:43:49.401921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:49.401902 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:50.975211 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.975189 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:50.976116 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.976101 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:50.976216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.976134 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:50.976216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.976151 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:50.976216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.976180 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-65.ec2.internal" Jul 27 11:43:50.989272 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:50.989226 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-65.ec2.internal" Jul 27 11:43:50.989272 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:50.989248 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-65.ec2.internal\": node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.017382 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.017357 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.049600 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.049559 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal"] Jul 27 11:43:51.049746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.049639 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:51.051203 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.051184 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:51.051282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.051217 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:51.051282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.051227 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:51.053389 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.053376 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:51.053542 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.053528 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.053586 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.053557 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:51.054070 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054055 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:51.054134 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054070 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:51.054134 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054083 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:51.054134 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054092 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:51.054134 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054099 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:51.054134 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.054102 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:51.056105 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.056091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.056159 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.056119 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 11:43:51.056756 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.056736 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientMemory" Jul 27 11:43:51.056855 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.056765 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 11:43:51.056855 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.056775 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeHasSufficientPID" Jul 27 11:43:51.076520 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.076499 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-65.ec2.internal\" not found" node="ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.081179 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.081163 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-65.ec2.internal\" not found" node="ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.114269 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.114240 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.114397 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.114273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e32bf3d80b75a9d91996cec2e03082-config\") pod \"kube-apiserver-proxy-ip-10-0-138-65.ec2.internal\" (UID: \"08e32bf3d80b75a9d91996cec2e03082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.114397 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.114297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.118345 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.118326 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.214767 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.214767 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e32bf3d80b75a9d91996cec2e03082-config\") pod \"kube-apiserver-proxy-ip-10-0-138-65.ec2.internal\" (UID: \"08e32bf3d80b75a9d91996cec2e03082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.214971 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.214971 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214832 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08e32bf3d80b75a9d91996cec2e03082-config\") pod \"kube-apiserver-proxy-ip-10-0-138-65.ec2.internal\" (UID: \"08e32bf3d80b75a9d91996cec2e03082\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.214971 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214843 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.214971 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.214892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e1b96defe42ab4ac1f12476e1dc76a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal\" (UID: \"9e1b96defe42ab4ac1f12476e1dc76a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.218835 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.218818 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.319623 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.319558 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.379778 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.379743 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.384753 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.384512 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:51.420368 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.420336 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.520873 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.520841 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.621400 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.621320 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.721851 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.721825 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.755011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.754983 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 11:43:51.755458 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.755160 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 11:43:51.755458 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.755160 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 11:43:51.813168 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.812895 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 11:38:50 +0000 UTC" deadline="2028-05-10 00:43:47.904991552 +0000 UTC" Jul 27 11:43:51.813168 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.812926 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15660h59m56.092070021s" Jul 27 11:43:51.822446 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.822201 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.922491 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:51.922416 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:51.939562 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:51.939520 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1b96defe42ab4ac1f12476e1dc76a7.slice/crio-0acdfb19d0aa895432bd749d2b62cdcda46ef74fe6d5b356f3e0cf51d737685d WatchSource:0}: Error finding container 0acdfb19d0aa895432bd749d2b62cdcda46ef74fe6d5b356f3e0cf51d737685d: Status 404 returned error can't find the container with id 0acdfb19d0aa895432bd749d2b62cdcda46ef74fe6d5b356f3e0cf51d737685d Jul 27 11:43:51.939756 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:51.939738 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e32bf3d80b75a9d91996cec2e03082.slice/crio-ec7b51450ea52a3aa0448b4c03735bc9bdd36f530e4ec13ed30aadf8ee79f623 WatchSource:0}: Error finding container ec7b51450ea52a3aa0448b4c03735bc9bdd36f530e4ec13ed30aadf8ee79f623: Status 404 returned error can't find the container with id ec7b51450ea52a3aa0448b4c03735bc9bdd36f530e4ec13ed30aadf8ee79f623 Jul 27 11:43:51.943902 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.943881 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 11:43:51.952170 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.952126 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" event={"ID":"08e32bf3d80b75a9d91996cec2e03082","Type":"ContainerStarted","Data":"ec7b51450ea52a3aa0448b4c03735bc9bdd36f530e4ec13ed30aadf8ee79f623"} Jul 27 11:43:51.953101 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:51.953084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" event={"ID":"9e1b96defe42ab4ac1f12476e1dc76a7","Type":"ContainerStarted","Data":"0acdfb19d0aa895432bd749d2b62cdcda46ef74fe6d5b356f3e0cf51d737685d"} Jul 27 11:43:52.022866 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.022816 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:52.123289 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.123258 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:52.223750 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.223689 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:52.324514 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.324481 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-65.ec2.internal\" not found" Jul 27 11:43:52.351447 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.351416 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:52.380925 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.380896 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:52.411926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.411891 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" Jul 27 11:43:52.424914 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.424884 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 11:43:52.426016 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.425991 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" Jul 27 11:43:52.435585 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.435488 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 11:43:52.669150 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.669059 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:52.792747 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.792715 2583 apiserver.go:52] "Watching apiserver" Jul 27 11:43:52.799428 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.799269 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 11:43:52.800565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.800531 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-x5dcr","openshift-network-operator/iptables-alerter-q74l5","openshift-ovn-kubernetes/ovnkube-node-g6x2x","kube-system/global-pull-secret-syncer-w4zct","kube-system/konnectivity-agent-pcrbk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm","openshift-image-registry/node-ca-n45vf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal","openshift-multus/multus-additional-cni-plugins-xtcq9","openshift-multus/multus-fs8hj","openshift-multus/network-metrics-daemon-tfwxs","kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal","openshift-cluster-node-tuning-operator/tuned-trm9k","openshift-dns/node-resolver-wp5sl"] Jul 27 11:43:52.803251 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.803145 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.805699 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.805408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.805699 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.805647 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 11:43:52.805883 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.805725 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 11:43:52.805962 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.805943 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6txxk\"" Jul 27 11:43:52.807606 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.807586 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 11:43:52.807994 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.807974 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hkvw7\"" Jul 27 11:43:52.808249 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.808221 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.808422 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.808405 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.809301 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.809167 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.812857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812470 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 11:43:52.812857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.812857 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.812594 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:43:52.812857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812752 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-slhlp\"" Jul 27 11:43:52.812857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812854 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.813147 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812965 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 11:43:52.813147 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.812993 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 11:43:52.813147 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.813053 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.813684 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.813194 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 11:43:52.813684 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.813232 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 11:43:52.814481 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.814443 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.819156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.817514 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.819156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.817926 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.819156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.818217 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kpctl\"" Jul 27 11:43:52.819618 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.819598 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.820486 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.820468 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 11:43:52.821832 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.821810 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 11:43:52.822137 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.822108 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fxjgb\"" Jul 27 11:43:52.822137 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.822124 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.822290 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.822282 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.822579 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.822562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:52.822659 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.822627 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d854adc-4f2c-4730-af21-40e1c9d864cb-agent-certs\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb13a4c2-0612-49b0-9922-5311b5593421-serviceca\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823440 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6112f0dd-8f0c-4a80-83f3-609a633d493c-iptables-alerter-script\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823463 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-var-lib-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823488 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-etc-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823513 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-netd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823558 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-config\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823586 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-kubelet\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-slash\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823636 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-bin\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823660 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-dbus\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823687 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-systemd-units\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-script-lib\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823741 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6112f0dd-8f0c-4a80-83f3-609a633d493c-host-slash\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.823891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-netns\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-node-log\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823845 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823871 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6hwd\" (UniqueName: \"kubernetes.io/projected/6112f0dd-8f0c-4a80-83f3-609a633d493c-kube-api-access-q6hwd\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x587d\" (UniqueName: \"kubernetes.io/projected/eb13a4c2-0612-49b0-9922-5311b5593421-kube-api-access-x587d\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823921 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-log-socket\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb13a4c2-0612-49b0-9922-5311b5593421-host\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.823987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-kubelet-config\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824038 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d854adc-4f2c-4730-af21-40e1c9d864cb-konnectivity-ca\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-systemd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-ovn\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-env-overrides\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97377f06-2989-4954-a6f3-02dafeeb3531-ovn-node-metrics-cert\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rh6d\" (UniqueName: \"kubernetes.io/projected/97377f06-2989-4954-a6f3-02dafeeb3531-kube-api-access-9rh6d\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.824643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824375 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 11:43:52.825391 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.824935 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.827545 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827523 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ks76f\"" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827751 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827782 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827819 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827825 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827894 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 11:43:52.827990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.827823 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 11:43:52.830005 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.829944 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:52.830110 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.830014 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:43:52.830573 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.830388 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 11:43:52.830665 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.830593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gm5nk\"" Jul 27 11:43:52.832744 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.832727 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.835251 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.835230 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.835345 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.835273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:52.835402 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.835345 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2hvz5\"" Jul 27 11:43:52.835943 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.835875 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.837663 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.837645 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 11:43:52.837821 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.837804 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 11:43:52.838178 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.838159 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbxhj\"" Jul 27 11:43:52.845056 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.845037 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sd6b2" Jul 27 11:43:52.852649 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.852626 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sd6b2" Jul 27 11:43:52.913806 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.913725 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 11:43:52.924936 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.924863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.924936 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.924895 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.924936 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.924915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:52.924936 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.924933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-conf\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.925204 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.925029 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:52.925204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-tmp\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.925204 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:52.925092 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:43:53.425073742 +0000 UTC m=+2.957424799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:52.925204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-bin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925171 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-conf-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-device-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925246 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925270 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-cni-binary-copy\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb13a4c2-0612-49b0-9922-5311b5593421-host\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925323 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-kubelet-config\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925379 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-multus\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925407 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/9b9dc7a5-dab3-4784-8d64-af98315a305d-kube-api-access-b9psk\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925379 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb13a4c2-0612-49b0-9922-5311b5593421-host\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925414 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-env-overrides\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-k8s-cni-cncf-io\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925491 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-kubelet-config\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925507 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-daemon-config\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-var-lib-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925583 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925608 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-var-lib-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-config\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925666 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cnibin\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925690 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-os-release\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925710 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925747 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-lib-modules\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925773 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-system-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-cnibin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-kubelet\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-slash\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.925965 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-dbus\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925909 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-kubelet\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-hostroot\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-env-overrides\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.925976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-systemd-units\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926010 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-script-lib\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926013 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-slash\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8p4\" (UniqueName: \"kubernetes.io/projected/d6054cf0-a845-4b74-b897-4ffe70a0ea83-kube-api-access-5s8p4\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5nw\" (UniqueName: \"kubernetes.io/projected/6e9231d6-e22d-4239-a791-4d51ea96aa11-kube-api-access-4p5nw\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926068 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-systemd-units\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926085 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvk7q\" (UniqueName: \"kubernetes.io/projected/d7d34400-f527-4fa2-ac46-d5e9ef31c762-kube-api-access-kvk7q\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-netns\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-node-log\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-config\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6hwd\" (UniqueName: \"kubernetes.io/projected/6112f0dd-8f0c-4a80-83f3-609a633d493c-kube-api-access-q6hwd\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4baa8c7-13b7-418b-a600-134ae04cec0a-dbus\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926230 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-node-log\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.926822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-etc-tuned\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tgm5\" (UniqueName: \"kubernetes.io/projected/4c243ca6-3e14-4593-86d4-1962c4368772-kube-api-access-9tgm5\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-kubelet\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926314 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926342 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x587d\" (UniqueName: \"kubernetes.io/projected/eb13a4c2-0612-49b0-9922-5311b5593421-kube-api-access-x587d\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926365 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-log-socket\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926410 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-multus-certs\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-etc-kubernetes\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926448 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926465 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926476 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926489 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-log-socket\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-sys\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926429 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-run-netns\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926528 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926561 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d854adc-4f2c-4730-af21-40e1c9d864cb-konnectivity-ca\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.927611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926562 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97377f06-2989-4954-a6f3-02dafeeb3531-ovnkube-script-lib\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926609 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-systemd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-ovn\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926644 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-systemd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97377f06-2989-4954-a6f3-02dafeeb3531-ovn-node-metrics-cert\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926682 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rh6d\" (UniqueName: \"kubernetes.io/projected/97377f06-2989-4954-a6f3-02dafeeb3531-kube-api-access-9rh6d\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926689 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-run-ovn\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-var-lib-kubelet\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d854adc-4f2c-4730-af21-40e1c9d864cb-agent-certs\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb13a4c2-0612-49b0-9922-5311b5593421-serviceca\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926829 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6112f0dd-8f0c-4a80-83f3-609a633d493c-iptables-alerter-script\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926910 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-modprobe-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d34400-f527-4fa2-ac46-d5e9ef31c762-tmp-dir\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:52.928320 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.926996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-etc-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-netd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-kubernetes\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927067 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-host\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927067 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d854adc-4f2c-4730-af21-40e1c9d864cb-konnectivity-ca\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-netns\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927108 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnl9\" (UniqueName: \"kubernetes.io/projected/10597122-4091-4d31-aebb-7c4d33b9dd6d-kube-api-access-pgnl9\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927133 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-etc-openvswitch\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d34400-f527-4fa2-ac46-d5e9ef31c762-hosts-file\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-bin\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927180 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-netd\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-system-cni-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927246 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysconfig\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927274 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97377f06-2989-4954-a6f3-02dafeeb3531-host-cni-bin\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-systemd\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-os-release\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.928921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927358 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-socket-dir-parent\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927423 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6112f0dd-8f0c-4a80-83f3-609a633d493c-host-slash\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927504 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb13a4c2-0612-49b0-9922-5311b5593421-serviceca\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927478 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6112f0dd-8f0c-4a80-83f3-609a633d493c-iptables-alerter-script\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927521 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6112f0dd-8f0c-4a80-83f3-609a633d493c-host-slash\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.929529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.927540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-run\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:52.930396 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.930377 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97377f06-2989-4954-a6f3-02dafeeb3531-ovn-node-metrics-cert\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.930498 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.930436 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d854adc-4f2c-4730-af21-40e1c9d864cb-agent-certs\") pod \"konnectivity-agent-pcrbk\" (UID: \"4d854adc-4f2c-4730-af21-40e1c9d864cb\") " pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:52.937731 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.937700 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6hwd\" (UniqueName: \"kubernetes.io/projected/6112f0dd-8f0c-4a80-83f3-609a633d493c-kube-api-access-q6hwd\") pod \"iptables-alerter-q74l5\" (UID: \"6112f0dd-8f0c-4a80-83f3-609a633d493c\") " pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:52.938012 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.937993 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rh6d\" (UniqueName: \"kubernetes.io/projected/97377f06-2989-4954-a6f3-02dafeeb3531-kube-api-access-9rh6d\") pod \"ovnkube-node-g6x2x\" (UID: \"97377f06-2989-4954-a6f3-02dafeeb3531\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:52.938356 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:52.938337 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x587d\" (UniqueName: \"kubernetes.io/projected/eb13a4c2-0612-49b0-9922-5311b5593421-kube-api-access-x587d\") pod \"node-ca-n45vf\" (UID: \"eb13a4c2-0612-49b0-9922-5311b5593421\") " pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:53.028556 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8p4\" (UniqueName: \"kubernetes.io/projected/d6054cf0-a845-4b74-b897-4ffe70a0ea83-kube-api-access-5s8p4\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.028556 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5nw\" (UniqueName: \"kubernetes.io/projected/6e9231d6-e22d-4239-a791-4d51ea96aa11-kube-api-access-4p5nw\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.028851 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028581 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvk7q\" (UniqueName: \"kubernetes.io/projected/d7d34400-f527-4fa2-ac46-d5e9ef31c762-kube-api-access-kvk7q\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.028851 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-etc-tuned\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.028851 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028732 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tgm5\" (UniqueName: \"kubernetes.io/projected/4c243ca6-3e14-4593-86d4-1962c4368772-kube-api-access-9tgm5\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.028851 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028808 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-kubelet\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.028851 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-multus-certs\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-etc-kubernetes\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028955 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028975 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-multus-certs\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029007 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-etc-kubernetes\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.028850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-kubelet\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-sys\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029075 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-sys\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.029127 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-var-lib-kubelet\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-var-lib-kubelet\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029183 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029129 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.029129 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.029274 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:43:53.529256293 +0000 UTC m=+3.061607322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-modprobe-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029207 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-modprobe-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d34400-f527-4fa2-ac46-d5e9ef31c762-tmp-dir\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029462 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029496 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-kubernetes\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029514 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-host\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-netns\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnl9\" (UniqueName: \"kubernetes.io/projected/10597122-4091-4d31-aebb-7c4d33b9dd6d-kube-api-access-pgnl9\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d34400-f527-4fa2-ac46-d5e9ef31c762-hosts-file\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029597 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-kubernetes\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.029743 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-system-cni-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029631 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysconfig\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029656 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-systemd\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-os-release\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029694 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7d34400-f527-4fa2-ac46-d5e9ef31c762-hosts-file\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-socket-dir-parent\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029726 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7d34400-f527-4fa2-ac46-d5e9ef31c762-tmp-dir\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029736 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-host\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029739 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029755 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-binary-copy\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029766 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-run\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029778 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-system-cni-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-socket-dir-parent\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029862 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-systemd\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.030591 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029819 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-netns\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-conf\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029938 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-run\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.029993 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-os-release\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030017 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysconfig\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030020 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-tmp\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-bin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030020 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-conf\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-conf-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030104 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030119 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-bin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-device-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-conf-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030242 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-cni-binary-copy\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6054cf0-a845-4b74-b897-4ffe70a0ea83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.031282 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030289 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b9dc7a5-dab3-4784-8d64-af98315a305d-device-dir\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-multus\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/9b9dc7a5-dab3-4784-8d64-af98315a305d-kube-api-access-b9psk\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030356 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-var-lib-cni-multus\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-k8s-cni-cncf-io\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-daemon-config\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cnibin\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-os-release\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030497 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-lib-modules\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-host-run-k8s-cni-cncf-io\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-system-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030513 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-etc-sysctl-d\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-cnibin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-cnibin\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030588 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-cnibin\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030643 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-system-cni-dir\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.031956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030675 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6054cf0-a845-4b74-b897-4ffe70a0ea83-os-release\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c243ca6-3e14-4593-86d4-1962c4368772-lib-modules\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-hostroot\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.030716 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e9231d6-e22d-4239-a791-4d51ea96aa11-hostroot\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.031309 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-cni-binary-copy\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.031440 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e9231d6-e22d-4239-a791-4d51ea96aa11-multus-daemon-config\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.031500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-etc-tuned\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.032544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.032271 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c243ca6-3e14-4593-86d4-1962c4368772-tmp\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.036616 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.036592 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:43:53.036722 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.036619 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:43:53.036722 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.036640 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:53.036722 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.036715 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:43:53.536695555 +0000 UTC m=+3.069046596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:53.038336 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.038045 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvk7q\" (UniqueName: \"kubernetes.io/projected/d7d34400-f527-4fa2-ac46-d5e9ef31c762-kube-api-access-kvk7q\") pod \"node-resolver-wp5sl\" (UID: \"d7d34400-f527-4fa2-ac46-d5e9ef31c762\") " pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.038336 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.038296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnl9\" (UniqueName: \"kubernetes.io/projected/10597122-4091-4d31-aebb-7c4d33b9dd6d-kube-api-access-pgnl9\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:53.038512 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.038495 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tgm5\" (UniqueName: \"kubernetes.io/projected/4c243ca6-3e14-4593-86d4-1962c4368772-kube-api-access-9tgm5\") pod \"tuned-trm9k\" (UID: \"4c243ca6-3e14-4593-86d4-1962c4368772\") " pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.038881 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.038857 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8p4\" (UniqueName: \"kubernetes.io/projected/d6054cf0-a845-4b74-b897-4ffe70a0ea83-kube-api-access-5s8p4\") pod \"multus-additional-cni-plugins-xtcq9\" (UID: \"d6054cf0-a845-4b74-b897-4ffe70a0ea83\") " pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.039495 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.039473 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5nw\" (UniqueName: \"kubernetes.io/projected/6e9231d6-e22d-4239-a791-4d51ea96aa11-kube-api-access-4p5nw\") pod \"multus-fs8hj\" (UID: \"6e9231d6-e22d-4239-a791-4d51ea96aa11\") " pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.039594 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.039504 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9psk\" (UniqueName: \"kubernetes.io/projected/9b9dc7a5-dab3-4784-8d64-af98315a305d-kube-api-access-b9psk\") pod \"aws-ebs-csi-driver-node-h8grm\" (UID: \"9b9dc7a5-dab3-4784-8d64-af98315a305d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.117626 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.117587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:43:53.128227 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.128204 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n45vf" Jul 27 11:43:53.137220 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.137189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:43:53.145950 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.145923 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q74l5" Jul 27 11:43:53.152648 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.152620 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" Jul 27 11:43:53.160312 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.160293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" Jul 27 11:43:53.167004 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.166985 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fs8hj" Jul 27 11:43:53.171637 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.171618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trm9k" Jul 27 11:43:53.177188 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.177144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wp5sl" Jul 27 11:43:53.218428 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.218403 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 11:43:53.432623 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.432532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:53.432771 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.432714 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:53.432848 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.432806 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:43:54.432772902 +0000 UTC m=+3.965123942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:53.533693 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.533653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:53.533863 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.533818 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:53.533923 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.533899 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:43:54.53387895 +0000 UTC m=+4.066229976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:53.634418 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.634376 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:53.634593 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.634543 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:43:53.634593 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.634569 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:43:53.634593 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.634583 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:53.634706 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.634640 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:43:54.634627602 +0000 UTC m=+4.166978628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:53.855656 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.855610 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 11:38:52 +0000 UTC" deadline="2028-01-20 01:50:52.15816726 +0000 UTC" Jul 27 11:43:53.855656 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.855654 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12998h6m58.302516313s" Jul 27 11:43:53.863152 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.863116 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9231d6_e22d_4239_a791_4d51ea96aa11.slice/crio-582c78d740dabc17d003f2635468f41d103c5a8bdd3beb5d7dee127bfb0be4d5 WatchSource:0}: Error finding container 582c78d740dabc17d003f2635468f41d103c5a8bdd3beb5d7dee127bfb0be4d5: Status 404 returned error can't find the container with id 582c78d740dabc17d003f2635468f41d103c5a8bdd3beb5d7dee127bfb0be4d5 Jul 27 11:43:53.864934 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.864806 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d34400_f527_4fa2_ac46_d5e9ef31c762.slice/crio-3e84a882bd011dcb78f8f30489a71294c81fb79b457c531c0c863bb2130ceb4f WatchSource:0}: Error finding container 3e84a882bd011dcb78f8f30489a71294c81fb79b457c531c0c863bb2130ceb4f: Status 404 returned error can't find the container with id 3e84a882bd011dcb78f8f30489a71294c81fb79b457c531c0c863bb2130ceb4f Jul 27 11:43:53.868323 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.868297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97377f06_2989_4954_a6f3_02dafeeb3531.slice/crio-5aafa169cc869ad923464bc86d28f9fa84e30065c8132bb95543293224cc2e56 WatchSource:0}: Error finding container 5aafa169cc869ad923464bc86d28f9fa84e30065c8132bb95543293224cc2e56: Status 404 returned error can't find the container with id 5aafa169cc869ad923464bc86d28f9fa84e30065c8132bb95543293224cc2e56 Jul 27 11:43:53.870111 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.870092 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9dc7a5_dab3_4784_8d64_af98315a305d.slice/crio-a4a09d74cb6414ee7d10b36fa0077b88ec40d5e7071c1ce668e3e26720bd1024 WatchSource:0}: Error finding container a4a09d74cb6414ee7d10b36fa0077b88ec40d5e7071c1ce668e3e26720bd1024: Status 404 returned error can't find the container with id a4a09d74cb6414ee7d10b36fa0077b88ec40d5e7071c1ce668e3e26720bd1024 Jul 27 11:43:53.871401 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.871378 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c243ca6_3e14_4593_86d4_1962c4368772.slice/crio-7229a57f108fc4e50078def3bbcdbf32f51575ec8a187ad741e4e73cf171a297 WatchSource:0}: Error finding container 7229a57f108fc4e50078def3bbcdbf32f51575ec8a187ad741e4e73cf171a297: Status 404 returned error can't find the container with id 7229a57f108fc4e50078def3bbcdbf32f51575ec8a187ad741e4e73cf171a297 Jul 27 11:43:53.872865 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.872137 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb13a4c2_0612_49b0_9922_5311b5593421.slice/crio-c30e9da7f1b94dcb4e981a673dc03fb02dc42794771ff4766d021b36f47445aa WatchSource:0}: Error finding container c30e9da7f1b94dcb4e981a673dc03fb02dc42794771ff4766d021b36f47445aa: Status 404 returned error can't find the container with id c30e9da7f1b94dcb4e981a673dc03fb02dc42794771ff4766d021b36f47445aa Jul 27 11:43:53.873574 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.873188 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6112f0dd_8f0c_4a80_83f3_609a633d493c.slice/crio-1504ce04a1e553c114aae1a1fa3f6e347162a26be614e095c888ff751bf45094 WatchSource:0}: Error finding container 1504ce04a1e553c114aae1a1fa3f6e347162a26be614e095c888ff751bf45094: Status 404 returned error can't find the container with id 1504ce04a1e553c114aae1a1fa3f6e347162a26be614e095c888ff751bf45094 Jul 27 11:43:53.874112 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.873922 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d854adc_4f2c_4730_af21_40e1c9d864cb.slice/crio-cf057e98e9bad47e5e86cdb23dbf9e1f22dd115975b281f2fb5c58cf2fc185ed WatchSource:0}: Error finding container cf057e98e9bad47e5e86cdb23dbf9e1f22dd115975b281f2fb5c58cf2fc185ed: Status 404 returned error can't find the container with id cf057e98e9bad47e5e86cdb23dbf9e1f22dd115975b281f2fb5c58cf2fc185ed Jul 27 11:43:53.875420 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:43:53.875179 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6054cf0_a845_4b74_b897_4ffe70a0ea83.slice/crio-1a2d8a0d2c2a8db3c58bd94057edbdc94999b66062abfe4d55dc68c6202517ed WatchSource:0}: Error finding container 1a2d8a0d2c2a8db3c58bd94057edbdc94999b66062abfe4d55dc68c6202517ed: Status 404 returned error can't find the container with id 1a2d8a0d2c2a8db3c58bd94057edbdc94999b66062abfe4d55dc68c6202517ed Jul 27 11:43:53.949267 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.949087 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:53.949378 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.949106 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:53.949378 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.949363 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:43:53.949482 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:53.949437 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:43:53.957852 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.957826 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" event={"ID":"9b9dc7a5-dab3-4784-8d64-af98315a305d","Type":"ContainerStarted","Data":"a4a09d74cb6414ee7d10b36fa0077b88ec40d5e7071c1ce668e3e26720bd1024"} Jul 27 11:43:53.959049 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.959024 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wp5sl" event={"ID":"d7d34400-f527-4fa2-ac46-d5e9ef31c762","Type":"ContainerStarted","Data":"3e84a882bd011dcb78f8f30489a71294c81fb79b457c531c0c863bb2130ceb4f"} Jul 27 11:43:53.960241 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.960188 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pcrbk" event={"ID":"4d854adc-4f2c-4730-af21-40e1c9d864cb","Type":"ContainerStarted","Data":"cf057e98e9bad47e5e86cdb23dbf9e1f22dd115975b281f2fb5c58cf2fc185ed"} Jul 27 11:43:53.963021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.962997 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q74l5" event={"ID":"6112f0dd-8f0c-4a80-83f3-609a633d493c","Type":"ContainerStarted","Data":"1504ce04a1e553c114aae1a1fa3f6e347162a26be614e095c888ff751bf45094"} Jul 27 11:43:53.964959 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.964932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n45vf" event={"ID":"eb13a4c2-0612-49b0-9922-5311b5593421","Type":"ContainerStarted","Data":"c30e9da7f1b94dcb4e981a673dc03fb02dc42794771ff4766d021b36f47445aa"} Jul 27 11:43:53.966053 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.966033 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trm9k" event={"ID":"4c243ca6-3e14-4593-86d4-1962c4368772","Type":"ContainerStarted","Data":"7229a57f108fc4e50078def3bbcdbf32f51575ec8a187ad741e4e73cf171a297"} Jul 27 11:43:53.967171 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.967150 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerStarted","Data":"1a2d8a0d2c2a8db3c58bd94057edbdc94999b66062abfe4d55dc68c6202517ed"} Jul 27 11:43:53.968234 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.968213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"5aafa169cc869ad923464bc86d28f9fa84e30065c8132bb95543293224cc2e56"} Jul 27 11:43:53.969364 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.969344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fs8hj" event={"ID":"6e9231d6-e22d-4239-a791-4d51ea96aa11","Type":"ContainerStarted","Data":"582c78d740dabc17d003f2635468f41d103c5a8bdd3beb5d7dee127bfb0be4d5"} Jul 27 11:43:53.971132 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:53.971111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" event={"ID":"08e32bf3d80b75a9d91996cec2e03082","Type":"ContainerStarted","Data":"4d1ab4c43d20eefbd844f06bbe6d9373e6556801cbc85a5f1eae2dc4fd81fa95"} Jul 27 11:43:54.442658 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.442619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:54.442881 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.442862 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:54.442975 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.442935 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:43:56.44291646 +0000 UTC m=+5.975267487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:54.543752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.543697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:54.544042 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.544020 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:54.544124 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.544108 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:43:56.544078557 +0000 UTC m=+6.076429586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:54.645049 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.644306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:54.645049 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.644484 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:43:54.645049 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.644504 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:43:54.645049 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.644518 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:54.645049 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.644577 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:43:56.644558915 +0000 UTC m=+6.176909945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:54.856330 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.856235 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 11:38:52 +0000 UTC" deadline="2028-04-19 22:07:10.282348248 +0000 UTC" Jul 27 11:43:54.856330 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.856272 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15178h23m15.42608075s" Jul 27 11:43:54.950629 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.950575 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:54.950834 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:54.950700 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:43:54.977655 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.976969 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e1b96defe42ab4ac1f12476e1dc76a7" containerID="6f2045deb6797a4cd4639cffa92e0189a456ed34d3fac01abae86ef3922f8d63" exitCode=0 Jul 27 11:43:54.977655 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.977597 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" event={"ID":"9e1b96defe42ab4ac1f12476e1dc76a7","Type":"ContainerDied","Data":"6f2045deb6797a4cd4639cffa92e0189a456ed34d3fac01abae86ef3922f8d63"} Jul 27 11:43:55.003824 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:54.996706 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-65.ec2.internal" podStartSLOduration=2.9966835290000002 podStartE2EDuration="2.996683529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:43:53.986858688 +0000 UTC m=+3.519209734" watchObservedRunningTime="2026-07-27 11:43:54.996683529 +0000 UTC m=+4.529034578" Jul 27 11:43:55.949951 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:55.949904 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:55.950435 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:55.950026 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:43:55.950435 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:55.950400 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:55.950545 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:55.950496 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:43:56.005716 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:56.005681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" event={"ID":"9e1b96defe42ab4ac1f12476e1dc76a7","Type":"ContainerStarted","Data":"0cd66f24517af8c35bc1789dc71367aee57e0fb3a8d6b735490527a78964cc2e"} Jul 27 11:43:56.465639 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:56.465595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:56.465854 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.465826 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:56.465932 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.465893 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:44:00.465871671 +0000 UTC m=+9.998222700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:43:56.566479 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:56.566438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:56.566661 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.566638 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:56.566723 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.566710 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:44:00.566690377 +0000 UTC m=+10.099041420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:43:56.667822 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:56.667770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:56.667999 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.667949 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:43:56.667999 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.667974 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:43:56.667999 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.667987 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:56.668149 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.668057 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:44:00.668035118 +0000 UTC m=+10.200386161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:43:56.952029 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:56.951493 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:56.952029 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:56.951625 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:43:57.949222 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:57.949097 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:57.949222 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:57.949136 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:57.949469 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:57.949238 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:43:57.949656 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:57.949629 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:43:58.949696 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:58.949462 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:43:58.949696 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:58.949606 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:43:59.949993 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:59.949951 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:43:59.949993 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:43:59.949989 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:43:59.950480 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:59.950110 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:43:59.950566 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:43:59.950539 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:00.503102 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:00.503013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:00.503304 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.503161 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:00.503304 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.503242 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:44:08.5032185 +0000 UTC m=+18.035569539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:00.603990 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:00.603951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:00.604161 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.604140 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:00.604241 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.604226 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:44:08.604203133 +0000 UTC m=+18.136554162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:00.704860 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:00.704787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:00.705053 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.705020 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:44:00.705053 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.705039 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:44:00.705053 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.705051 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:00.705202 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.705110 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:44:08.705090702 +0000 UTC m=+18.237441746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:00.950200 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:00.950117 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:00.950642 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:00.950279 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:01.949328 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:01.949289 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:01.949500 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:01.949450 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:01.949586 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:01.949519 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:01.949645 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:01.949599 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:02.949568 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:02.949535 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:02.950078 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:02.949671 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:03.949664 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:03.949626 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:03.950081 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:03.949679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:03.950081 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:03.949749 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:03.950081 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:03.949898 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:04.949910 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:04.949875 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:04.950395 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:04.950008 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:05.949027 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:05.948990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:05.949200 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:05.949112 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:05.949200 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:05.949174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:05.949336 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:05.949315 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:06.949919 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:06.949880 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:06.950341 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:06.950024 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:07.949300 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:07.949262 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:07.949300 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:07.949262 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:07.949526 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:07.949416 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:07.949565 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:07.949528 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:08.566227 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:08.566175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:08.566640 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.566353 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:08.566640 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.566451 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:44:24.566412129 +0000 UTC m=+34.098763168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:08.667604 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:08.667570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:08.667783 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.667702 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:08.667783 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.667766 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:44:24.667751952 +0000 UTC m=+34.200102978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:08.768310 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:08.768271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:08.768541 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.768426 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:44:08.768541 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.768447 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:44:08.768541 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.768461 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:08.768541 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.768520 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:44:24.768506682 +0000 UTC m=+34.300857708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:08.950020 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:08.949987 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:08.950200 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:08.950116 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:09.949256 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:09.949221 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:09.949686 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:09.949221 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:09.949686 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:09.949345 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:09.949686 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:09.949428 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:10.950763 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:10.950729 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:10.951293 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:10.950866 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:11.949968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:11.949932 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:11.949968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:11.949954 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:11.950182 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:11.950058 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:11.950220 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:11.950181 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:12.950219 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:12.949983 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:12.950834 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:12.950340 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:13.041675 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.041579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trm9k" event={"ID":"4c243ca6-3e14-4593-86d4-1962c4368772","Type":"ContainerStarted","Data":"97edf304c25a35fd85bbd7e21cddd7a5912060bd9c30a92b691ed7be679421e6"} Jul 27 11:44:13.044207 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.044157 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="f51d87bd2d663924a36c5a744feb3cfbf85de743671d73de11888ec9b3587295" exitCode=0 Jul 27 11:44:13.044534 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.044332 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"f51d87bd2d663924a36c5a744feb3cfbf85de743671d73de11888ec9b3587295"} Jul 27 11:44:13.049987 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.049957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"da53303d7d004f5899a8d926e93f28e0c190e3ecb117126f2ca0adb0eedc2c4a"} Jul 27 11:44:13.050093 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.050044 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"596ce4548a9760817fd811ee6177029cef7479b06ee6c9a1d416eb8bd1c66aef"} Jul 27 11:44:13.050156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.050095 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"bae7366597a6717028746be90cd794f1fdd7c399bf5def519633a97b4724b369"} Jul 27 11:44:13.050156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.050144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"3e885f28fe33397240bd99196fd03e695e7518b96f6bbb9768b4c6347b6760da"} Jul 27 11:44:13.050263 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.050191 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"ba2b538518d1cd08fc22dd10e0f7a78786c1ba08ee3e93a69aa703c134281903"} Jul 27 11:44:13.050263 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.050238 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"3f92ab6a9134a0a3139437a01fa2544071ade7d9f265000bcfa333d0279623f8"} Jul 27 11:44:13.051926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.051899 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fs8hj" event={"ID":"6e9231d6-e22d-4239-a791-4d51ea96aa11","Type":"ContainerStarted","Data":"c10fd0cb789c5240346cceacce971cab8ecd57e81dc0cff86e7f6c76963b4277"} Jul 27 11:44:13.053544 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.053517 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" event={"ID":"9b9dc7a5-dab3-4784-8d64-af98315a305d","Type":"ContainerStarted","Data":"3830c6d865aa8a5e79f3528aa4cb5696407f6874897211f132287867dcb0f3d7"} Jul 27 11:44:13.055105 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.055082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wp5sl" event={"ID":"d7d34400-f527-4fa2-ac46-d5e9ef31c762","Type":"ContainerStarted","Data":"f9f266de1ef07262a5fe8744c97cab23b2a38ae1be01532e536456661e9f3415"} Jul 27 11:44:13.056575 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.056553 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pcrbk" event={"ID":"4d854adc-4f2c-4730-af21-40e1c9d864cb","Type":"ContainerStarted","Data":"0ce151dd810484fcc7099ed45246d56e6be40e63a9ae629f53b376358a1328db"} Jul 27 11:44:13.058080 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.058056 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n45vf" event={"ID":"eb13a4c2-0612-49b0-9922-5311b5593421","Type":"ContainerStarted","Data":"68420fd3d276ea8a3e299f7939a3d53ebc799981f0b92b44e014160690654813"} Jul 27 11:44:13.059626 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.059588 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-65.ec2.internal" podStartSLOduration=21.059576644 podStartE2EDuration="21.059576644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:43:56.022989016 +0000 UTC m=+5.555340065" watchObservedRunningTime="2026-07-27 11:44:13.059576644 +0000 UTC m=+22.591927693" Jul 27 11:44:13.059924 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.059896 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trm9k" podStartSLOduration=3.71869562 podStartE2EDuration="22.059886404s" totalImagesPullingTime="18.341190784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:13.059327357 +0000 UTC m=+22.591678407" watchObservedRunningTime="2026-07-27 11:44:13.059886404 +0000 UTC m=+22.592237452" Jul 27 11:44:13.080448 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.080390 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pcrbk" podStartSLOduration=9.130248215 podStartE2EDuration="23.080372057s" totalImagesPullingTime="13.950123842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:13.080318021 +0000 UTC m=+22.612669068" watchObservedRunningTime="2026-07-27 11:44:13.080372057 +0000 UTC m=+22.612723134" Jul 27 11:44:13.120740 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.120687 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wp5sl" podStartSLOduration=3.777596047 podStartE2EDuration="22.120671635s" totalImagesPullingTime="18.343075588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:13.120150687 +0000 UTC m=+22.652501736" watchObservedRunningTime="2026-07-27 11:44:13.120671635 +0000 UTC m=+22.653022683" Jul 27 11:44:13.136748 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.136701 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n45vf" podStartSLOduration=3.815366997 podStartE2EDuration="22.136685716s" totalImagesPullingTime="18.321318719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:13.136472709 +0000 UTC m=+22.668823760" watchObservedRunningTime="2026-07-27 11:44:13.136685716 +0000 UTC m=+22.669036765" Jul 27 11:44:13.160606 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.160546 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fs8hj" podStartSLOduration=3.76671194 podStartE2EDuration="22.16052508s" totalImagesPullingTime="18.39381314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:13.160256813 +0000 UTC m=+22.692607860" watchObservedRunningTime="2026-07-27 11:44:13.16052508 +0000 UTC m=+22.692876129" Jul 27 11:44:13.596847 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.596818 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 11:44:13.887970 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.887851 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T11:44:13.596841655Z","UUID":"ad14888b-de3d-47c8-9d16-1f05d1a48050","Handler":null,"Name":"","Endpoint":""} Jul 27 11:44:13.889415 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.889391 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 11:44:13.889531 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.889433 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 11:44:13.949237 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.949209 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:13.949237 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:13.949239 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:13.949509 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:13.949354 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:13.949509 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:13.949468 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:14.062917 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:14.062866 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" event={"ID":"9b9dc7a5-dab3-4784-8d64-af98315a305d","Type":"ContainerStarted","Data":"b9a2357c1d747b80f0a2984b7da6a068f6104c49c45501bef8977d6aa72c0b59"} Jul 27 11:44:14.064648 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:14.064606 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q74l5" event={"ID":"6112f0dd-8f0c-4a80-83f3-609a633d493c","Type":"ContainerStarted","Data":"8fab78133b24582eb0d408d6888e4ae9f61e00d50c421b2ac560683b1e1ae2d1"} Jul 27 11:44:14.083324 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:14.083226 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q74l5" podStartSLOduration=4.762064284 podStartE2EDuration="23.083204348s" totalImagesPullingTime="18.321140064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:14.082720332 +0000 UTC m=+23.615071381" watchObservedRunningTime="2026-07-27 11:44:14.083204348 +0000 UTC m=+23.615555398" Jul 27 11:44:14.949331 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:14.949293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:14.949539 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:14.949516 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:15.068687 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:15.068652 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" event={"ID":"9b9dc7a5-dab3-4784-8d64-af98315a305d","Type":"ContainerStarted","Data":"ac68aa93c9621556962773f893c54ff6e540e469cb5f73520f12ec3272f807c1"} Jul 27 11:44:15.117773 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:15.117716 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8grm" podStartSLOduration=3.599514098 podStartE2EDuration="24.117692456s" totalImagesPullingTime="20.518178358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:15.11685287 +0000 UTC m=+24.649203917" watchObservedRunningTime="2026-07-27 11:44:15.117692456 +0000 UTC m=+24.650043504" Jul 27 11:44:15.949876 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:15.949831 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:15.950059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:15.949834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:15.950059 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:15.949974 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:15.950059 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:15.950043 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:16.075324 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:16.075285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"5e35a91f6b109e2d5408e012e75a4db50fb19c7eacebf3005643c48472606e5c"} Jul 27 11:44:16.949222 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:16.949190 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:16.949403 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:16.949319 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:17.680603 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:17.680419 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:44:17.681362 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:17.681029 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:44:17.949992 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:17.949961 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:17.950157 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:17.949971 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:17.950157 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:17.950092 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:17.950157 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:17.950127 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:18.080939 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:18.080907 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="674de389ee25e049533c5605d3f0a483b4ff1814f60450ee3e290cd97b5c66f2" exitCode=0 Jul 27 11:44:18.081116 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:18.080998 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"674de389ee25e049533c5605d3f0a483b4ff1814f60450ee3e290cd97b5c66f2"} Jul 27 11:44:18.084864 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:18.084836 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" event={"ID":"97377f06-2989-4954-a6f3-02dafeeb3531","Type":"ContainerStarted","Data":"ffba7b666aae283d87e0a32bd3959baf4279fc1a1a43658af19c72e035677f01"} Jul 27 11:44:18.129279 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:18.129228 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" podStartSLOduration=8.735553073 podStartE2EDuration="27.129210888s" totalImagesPullingTime="18.393657815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:18.128780444 +0000 UTC m=+27.661131492" watchObservedRunningTime="2026-07-27 11:44:18.129210888 +0000 UTC m=+27.661561933" Jul 27 11:44:18.949970 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:18.949784 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:18.950401 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:18.950048 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:19.087445 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.087374 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:19.087583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.087456 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:19.087583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.087495 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:19.102663 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.102638 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:19.102841 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.102743 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:19.665856 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.665817 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:44:19.666085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.665989 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 11:44:19.666740 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.666720 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pcrbk" Jul 27 11:44:19.949285 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.949198 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:19.949429 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:19.949214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:19.949429 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:19.949338 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:19.949429 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:19.949371 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:20.090534 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:20.090496 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="040cd3fbef0fef2e9f326881abab6067183d281507bad3d61f46d1caa5115e82" exitCode=0 Jul 27 11:44:20.090945 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:20.090577 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"040cd3fbef0fef2e9f326881abab6067183d281507bad3d61f46d1caa5115e82"} Jul 27 11:44:20.950492 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:20.950461 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:20.950677 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:20.950548 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:21.949425 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:21.949384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:21.949994 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:21.949429 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:21.949994 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:21.949519 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:21.949994 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:21.949613 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:22.097120 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:22.097090 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="a30fc5610909e81fcee121d8e45c4a341e42474c1a032ddf6a4190687039b243" exitCode=0 Jul 27 11:44:22.097274 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:22.097154 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"a30fc5610909e81fcee121d8e45c4a341e42474c1a032ddf6a4190687039b243"} Jul 27 11:44:22.949997 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:22.949967 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:22.950512 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:22.950099 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:23.949206 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:23.949176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:23.949403 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:23.949214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:23.949403 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:23.949272 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:23.949524 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:23.949403 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:24.589381 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:24.589341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:24.589878 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.589491 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:24.589878 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.589576 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret podName:f4baa8c7-13b7-418b-a600-134ae04cec0a nodeName:}" failed. No retries permitted until 2026-07-27 11:44:56.589556154 +0000 UTC m=+66.121907199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret") pod "global-pull-secret-syncer-w4zct" (UID: "f4baa8c7-13b7-418b-a600-134ae04cec0a") : object "kube-system"/"original-pull-secret" not registered Jul 27 11:44:24.689883 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:24.689852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:24.690077 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.690016 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:24.690077 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.690076 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs podName:10597122-4091-4d31-aebb-7c4d33b9dd6d nodeName:}" failed. No retries permitted until 2026-07-27 11:44:56.690061226 +0000 UTC m=+66.222412255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs") pod "network-metrics-daemon-tfwxs" (UID: "10597122-4091-4d31-aebb-7c4d33b9dd6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 11:44:24.790847 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:24.790811 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:24.791030 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.790941 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 11:44:24.791030 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.790957 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 11:44:24.791030 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.790968 2583 projected.go:196] Error preparing data for projected volume kube-api-access-f97q4 for pod openshift-network-diagnostics/network-check-target-x5dcr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:24.791030 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.791017 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4 podName:24088e29-a051-4fa2-bd46-d04ab5187a0c nodeName:}" failed. No retries permitted until 2026-07-27 11:44:56.791004028 +0000 UTC m=+66.323355054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f97q4" (UniqueName: "kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4") pod "network-check-target-x5dcr" (UID: "24088e29-a051-4fa2-bd46-d04ab5187a0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 11:44:24.949485 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:24.949445 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:24.949647 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:24.949586 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:25.949010 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:25.948982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:25.949417 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:25.948983 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:25.949417 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:25.949084 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:25.949417 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:25.949186 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:26.109825 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:26.109781 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerStarted","Data":"91fbb45db433330b54084719551cd91f54cd9ec4ee71b0b0be38a4e63a19e8f0"} Jul 27 11:44:26.949809 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:26.949761 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:26.950188 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:26.949880 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:27.114973 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:27.114939 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="91fbb45db433330b54084719551cd91f54cd9ec4ee71b0b0be38a4e63a19e8f0" exitCode=0 Jul 27 11:44:27.115135 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:27.114992 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"91fbb45db433330b54084719551cd91f54cd9ec4ee71b0b0be38a4e63a19e8f0"} Jul 27 11:44:27.949347 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:27.949297 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:27.949534 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:27.949305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:27.949534 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:27.949411 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:27.949534 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:27.949493 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:28.119737 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:28.119704 2583 generic.go:356] "Generic (PLEG): container finished" podID="d6054cf0-a845-4b74-b897-4ffe70a0ea83" containerID="2c56530281b1c4161aa4ee0a749ccbf6f5686a62ee465957186f1b502550835a" exitCode=0 Jul 27 11:44:28.119737 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:28.119740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerDied","Data":"2c56530281b1c4161aa4ee0a749ccbf6f5686a62ee465957186f1b502550835a"} Jul 27 11:44:28.949909 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:28.949879 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:28.950076 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:28.949980 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:29.125830 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:29.125781 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" event={"ID":"d6054cf0-a845-4b74-b897-4ffe70a0ea83","Type":"ContainerStarted","Data":"6224a183629f50f43389dbf9db41a5a7a63362cfcf147ca2efa5b45f1b0f14b6"} Jul 27 11:44:29.148411 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:29.148357 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xtcq9" podStartSLOduration=9.636414656 podStartE2EDuration="38.148342179s" totalImagesPullingTime="28.511927523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:29.146643673 +0000 UTC m=+38.678994721" watchObservedRunningTime="2026-07-27 11:44:29.148342179 +0000 UTC m=+38.680693227" Jul 27 11:44:29.949844 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:29.949811 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:29.949844 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:29.949835 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:29.950046 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:29.949928 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:29.950046 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:29.949986 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:30.950219 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:30.950186 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:30.950596 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:30.950276 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:31.949490 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:31.949457 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:31.949661 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:31.949457 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:31.949661 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:31.949580 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:31.949661 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:31.949627 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:32.949452 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:32.949422 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:32.949847 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:32.949530 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:33.949414 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:33.949379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:33.949589 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:33.949382 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:33.949589 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:33.949488 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:33.949589 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:33.949573 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:34.523076 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.521623 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4zct"] Jul 27 11:44:34.523076 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.522054 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:34.523076 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:34.522192 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:34.525602 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.525349 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5dcr"] Jul 27 11:44:34.525602 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.525470 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:34.525602 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:34.525571 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:34.525967 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.525943 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tfwxs"] Jul 27 11:44:34.526074 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:34.526050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:34.526334 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:34.526168 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:35.949219 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:35.949183 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:35.949721 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:35.949183 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:35.949721 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:35.949295 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:35.949721 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:35.949183 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:35.949721 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:35.949359 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:35.949721 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:35.949419 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:37.949377 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:37.949335 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:37.949843 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:37.949439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:37.949843 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:37.949533 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4zct" podUID="f4baa8c7-13b7-418b-a600-134ae04cec0a" Jul 27 11:44:37.949843 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:37.949444 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5dcr" podUID="24088e29-a051-4fa2-bd46-d04ab5187a0c" Jul 27 11:44:37.949843 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:37.949444 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:37.949843 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:37.949637 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfwxs" podUID="10597122-4091-4d31-aebb-7c4d33b9dd6d" Jul 27 11:44:38.263838 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.263811 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-65.ec2.internal" event="NodeReady" Jul 27 11:44:38.263998 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.263970 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 11:44:38.339469 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.339440 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84xbl"] Jul 27 11:44:38.376358 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.376319 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84xbl"] Jul 27 11:44:38.376358 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.376366 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gd8v9"] Jul 27 11:44:38.376550 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.376434 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.379215 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.379194 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xkm9w\"" Jul 27 11:44:38.379507 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.379462 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 11:44:38.379772 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.379753 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 11:44:38.379889 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.379748 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 11:44:38.388441 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.388418 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxhhn\" (UniqueName: \"kubernetes.io/projected/36774873-2f15-49c9-ad8d-fa432c79ede5-kube-api-access-nxhhn\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.388533 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.388480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36774873-2f15-49c9-ad8d-fa432c79ede5-cert\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.398241 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.398222 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gd8v9"] Jul 27 11:44:38.398317 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.398311 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.400931 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.400915 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 11:44:38.401252 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.401234 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 11:44:38.401569 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.401555 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 11:44:38.401699 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.401687 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 11:44:38.402048 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.402035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jlchp\"" Jul 27 11:44:38.426418 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.426395 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4vt7l"] Jul 27 11:44:38.450131 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.450101 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vt7l"] Jul 27 11:44:38.450269 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.450209 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.452910 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.452890 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mh9k2\"" Jul 27 11:44:38.453020 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.452892 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 11:44:38.453020 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.452980 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 11:44:38.489673 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489649 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-metrics-tls\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.489855 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxhhn\" (UniqueName: \"kubernetes.io/projected/36774873-2f15-49c9-ad8d-fa432c79ede5-kube-api-access-nxhhn\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.489855 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489715 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h68\" (UniqueName: \"kubernetes.io/projected/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-kube-api-access-g6h68\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.489855 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fae44be-49cd-4deb-82d2-090f52be9aa3-data-volume\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.489984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489878 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.489984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fae44be-49cd-4deb-82d2-090f52be9aa3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.489984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489932 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5st4\" (UniqueName: \"kubernetes.io/projected/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-api-access-l5st4\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.489984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36774873-2f15-49c9-ad8d-fa432c79ede5-cert\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.489984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-config-volume\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.490213 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.489987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-tmp-dir\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.490213 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.490020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fae44be-49cd-4deb-82d2-090f52be9aa3-crio-socket\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.494154 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.494131 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36774873-2f15-49c9-ad8d-fa432c79ede5-cert\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.511186 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.511154 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxhhn\" (UniqueName: \"kubernetes.io/projected/36774873-2f15-49c9-ad8d-fa432c79ede5-kube-api-access-nxhhn\") pod \"ingress-canary-84xbl\" (UID: \"36774873-2f15-49c9-ad8d-fa432c79ede5\") " pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.591052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.590969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5st4\" (UniqueName: \"kubernetes.io/projected/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-api-access-l5st4\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-config-volume\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-tmp-dir\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591052 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fae44be-49cd-4deb-82d2-090f52be9aa3-crio-socket\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-metrics-tls\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591108 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h68\" (UniqueName: \"kubernetes.io/projected/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-kube-api-access-g6h68\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fae44be-49cd-4deb-82d2-090f52be9aa3-data-volume\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591190 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fae44be-49cd-4deb-82d2-090f52be9aa3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591348 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591300 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6fae44be-49cd-4deb-82d2-090f52be9aa3-crio-socket\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591619 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591469 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-tmp-dir\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591619 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591604 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fae44be-49cd-4deb-82d2-090f52be9aa3-data-volume\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.591723 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591649 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-config-volume\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.591930 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.591908 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.593435 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.593412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-metrics-tls\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.593531 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.593515 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6fae44be-49cd-4deb-82d2-090f52be9aa3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.603863 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.603840 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5st4\" (UniqueName: \"kubernetes.io/projected/6fae44be-49cd-4deb-82d2-090f52be9aa3-kube-api-access-l5st4\") pod \"insights-runtime-extractor-gd8v9\" (UID: \"6fae44be-49cd-4deb-82d2-090f52be9aa3\") " pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.604119 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.604101 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h68\" (UniqueName: \"kubernetes.io/projected/49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9-kube-api-access-g6h68\") pod \"dns-default-4vt7l\" (UID: \"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9\") " pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.687564 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.687529 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84xbl" Jul 27 11:44:38.706908 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.706883 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gd8v9" Jul 27 11:44:38.758778 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.758749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:38.898836 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.898619 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84xbl"] Jul 27 11:44:38.900844 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.900552 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gd8v9"] Jul 27 11:44:38.903286 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:38.903240 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36774873_2f15_49c9_ad8d_fa432c79ede5.slice/crio-6aa671b939b36ddf8986bd97873893082b2947f3d3458f2ad03131dbf3539e3c WatchSource:0}: Error finding container 6aa671b939b36ddf8986bd97873893082b2947f3d3458f2ad03131dbf3539e3c: Status 404 returned error can't find the container with id 6aa671b939b36ddf8986bd97873893082b2947f3d3458f2ad03131dbf3539e3c Jul 27 11:44:38.929715 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:38.929690 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vt7l"] Jul 27 11:44:38.933646 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:38.933617 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e1ee6a_dc9d_4fa3_87b9_5ed4b11084b9.slice/crio-96860a523f88580f78a75b1017ccfa45229bface03aa6c561fc2a3366a43b632 WatchSource:0}: Error finding container 96860a523f88580f78a75b1017ccfa45229bface03aa6c561fc2a3366a43b632: Status 404 returned error can't find the container with id 96860a523f88580f78a75b1017ccfa45229bface03aa6c561fc2a3366a43b632 Jul 27 11:44:39.149465 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.149434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84xbl" event={"ID":"36774873-2f15-49c9-ad8d-fa432c79ede5","Type":"ContainerStarted","Data":"6aa671b939b36ddf8986bd97873893082b2947f3d3458f2ad03131dbf3539e3c"} Jul 27 11:44:39.150585 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.150557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vt7l" event={"ID":"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9","Type":"ContainerStarted","Data":"96860a523f88580f78a75b1017ccfa45229bface03aa6c561fc2a3366a43b632"} Jul 27 11:44:39.151683 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.151658 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd8v9" event={"ID":"6fae44be-49cd-4deb-82d2-090f52be9aa3","Type":"ContainerStarted","Data":"bfc3a4f4a0cdd0a4e54ff3920cfa573f03a2842eaec92484569723e87536ff7b"} Jul 27 11:44:39.949815 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.949769 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:39.951158 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.950259 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:39.951158 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.950587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:39.954411 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.954389 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 11:44:39.954809 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.954772 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 11:44:39.955472 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.955454 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpzsp\"" Jul 27 11:44:39.956082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.955666 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 11:44:39.956082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.955891 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 11:44:39.962649 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:39.962626 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prgdb\"" Jul 27 11:44:41.157043 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.156853 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-z6kjs"] Jul 27 11:44:41.169079 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.169053 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:44:41.170903 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.170844 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z6kjs"] Jul 27 11:44:41.172060 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.171910 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6qmpt\"" Jul 27 11:44:41.172185 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.172161 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 11:44:41.172447 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.172423 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 11:44:41.215365 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.215333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxpzl\" (UniqueName: \"kubernetes.io/projected/e04ea2c4-17b8-4df2-8fa2-07227aea9b41-kube-api-access-cxpzl\") pod \"downloads-7c97dc4555-z6kjs\" (UID: \"e04ea2c4-17b8-4df2-8fa2-07227aea9b41\") " pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:44:41.316290 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.316171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxpzl\" (UniqueName: \"kubernetes.io/projected/e04ea2c4-17b8-4df2-8fa2-07227aea9b41-kube-api-access-cxpzl\") pod \"downloads-7c97dc4555-z6kjs\" (UID: \"e04ea2c4-17b8-4df2-8fa2-07227aea9b41\") " pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:44:41.327802 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.327770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxpzl\" (UniqueName: \"kubernetes.io/projected/e04ea2c4-17b8-4df2-8fa2-07227aea9b41-kube-api-access-cxpzl\") pod \"downloads-7c97dc4555-z6kjs\" (UID: \"e04ea2c4-17b8-4df2-8fa2-07227aea9b41\") " pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:44:41.485195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.485122 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:44:41.643351 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.643319 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-htffw"] Jul 27 11:44:41.663749 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.663721 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-htffw"] Jul 27 11:44:41.663900 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.663849 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.666564 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.666540 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wj7pw\"" Jul 27 11:44:41.667342 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.667320 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 11:44:41.667445 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.667320 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 11:44:41.667521 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.667488 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 11:44:41.667521 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.667514 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 11:44:41.667625 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.667521 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 11:44:41.719466 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.719434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dd0145-d662-4941-b36d-bbde4f34e2df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.719466 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.719471 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vrb\" (UniqueName: \"kubernetes.io/projected/c1dd0145-d662-4941-b36d-bbde4f34e2df-kube-api-access-b2vrb\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.719672 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.719559 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.719672 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.719611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.820568 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.820481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vrb\" (UniqueName: \"kubernetes.io/projected/c1dd0145-d662-4941-b36d-bbde4f34e2df-kube-api-access-b2vrb\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.820568 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.820547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.820827 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.820600 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.820827 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.820678 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dd0145-d662-4941-b36d-bbde4f34e2df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.820827 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:41.820700 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 27 11:44:41.820827 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:41.820778 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls podName:c1dd0145-d662-4941-b36d-bbde4f34e2df nodeName:}" failed. No retries permitted until 2026-07-27 11:44:42.320758826 +0000 UTC m=+51.853109872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-htffw" (UID: "c1dd0145-d662-4941-b36d-bbde4f34e2df") : secret "prometheus-operator-tls" not found Jul 27 11:44:41.821430 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.821407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1dd0145-d662-4941-b36d-bbde4f34e2df-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.823501 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.823466 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:41.829712 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:41.829681 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vrb\" (UniqueName: \"kubernetes.io/projected/c1dd0145-d662-4941-b36d-bbde4f34e2df-kube-api-access-b2vrb\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:42.324557 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:42.324521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:42.326837 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:42.326806 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1dd0145-d662-4941-b36d-bbde4f34e2df-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-htffw\" (UID: \"c1dd0145-d662-4941-b36d-bbde4f34e2df\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:42.573891 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:42.573855 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" Jul 27 11:44:45.640653 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:45.640145 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-htffw"] Jul 27 11:44:45.647747 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:45.647716 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z6kjs"] Jul 27 11:44:45.652987 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:45.652758 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04ea2c4_17b8_4df2_8fa2_07227aea9b41.slice/crio-96b7fc28d8cbbe5c4bb6960d75b636eeeae45ac2518a9a17edfbb6c8639a9b06 WatchSource:0}: Error finding container 96b7fc28d8cbbe5c4bb6960d75b636eeeae45ac2518a9a17edfbb6c8639a9b06: Status 404 returned error can't find the container with id 96b7fc28d8cbbe5c4bb6960d75b636eeeae45ac2518a9a17edfbb6c8639a9b06 Jul 27 11:44:46.180311 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.179713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vt7l" event={"ID":"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9","Type":"ContainerStarted","Data":"ef222a705869bff311694797458642475ac00ed30888cf98c93f39ab5bc46480"} Jul 27 11:44:46.180311 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.180010 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vt7l" event={"ID":"49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9","Type":"ContainerStarted","Data":"7e765941ae48e750cf28c8996e9c97cb66da95eeb2444b30ed816ff741e10e86"} Jul 27 11:44:46.180311 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.180063 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:46.184680 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.183381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z6kjs" event={"ID":"e04ea2c4-17b8-4df2-8fa2-07227aea9b41","Type":"ContainerStarted","Data":"96b7fc28d8cbbe5c4bb6960d75b636eeeae45ac2518a9a17edfbb6c8639a9b06"} Jul 27 11:44:46.188279 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.187645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84xbl" event={"ID":"36774873-2f15-49c9-ad8d-fa432c79ede5","Type":"ContainerStarted","Data":"837ef85a088651fed001bc46d3571042def8fd29b7c15849452577e7c3f6f04f"} Jul 27 11:44:46.190727 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.190698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd8v9" event={"ID":"6fae44be-49cd-4deb-82d2-090f52be9aa3","Type":"ContainerStarted","Data":"7665e8788b01a9077230acab12e17da86c111769a4edf90127f8d7b4c1b34a4d"} Jul 27 11:44:46.192700 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.192673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" event={"ID":"c1dd0145-d662-4941-b36d-bbde4f34e2df","Type":"ContainerStarted","Data":"3a8d23567e4de8c6dd2bf212edbcbb1311382a2e710e49092becfe53e0b8a23c"} Jul 27 11:44:46.201582 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.201347 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4vt7l" podStartSLOduration=1.651406874 podStartE2EDuration="8.201327384s" totalImagesPullingTime="6.54992051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:46.199320331 +0000 UTC m=+55.731671381" watchObservedRunningTime="2026-07-27 11:44:46.201327384 +0000 UTC m=+55.733678434" Jul 27 11:44:46.215436 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:46.215375 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84xbl" podStartSLOduration=1.640269771 podStartE2EDuration="8.215353103s" totalImagesPullingTime="6.575083332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:46.214554457 +0000 UTC m=+55.746905527" watchObservedRunningTime="2026-07-27 11:44:46.215353103 +0000 UTC m=+55.747704151" Jul 27 11:44:48.203858 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:48.203814 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" event={"ID":"c1dd0145-d662-4941-b36d-bbde4f34e2df","Type":"ContainerStarted","Data":"72bb53790b4e31a82a67f0d6163548e8679a206e5667095bde7e562363adf9e4"} Jul 27 11:44:48.204297 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:48.203887 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" event={"ID":"c1dd0145-d662-4941-b36d-bbde4f34e2df","Type":"ContainerStarted","Data":"57b8a89bbe2f6707d45cc89b2587ff4bafca62d723097b04795c52aea6e63552"} Jul 27 11:44:48.222668 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:48.222611 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-htffw" podStartSLOduration=5.4718617290000005 podStartE2EDuration="7.222588421s" totalImagesPullingTime="1.750726692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:48.220879297 +0000 UTC m=+57.753230348" watchObservedRunningTime="2026-07-27 11:44:48.222588421 +0000 UTC m=+57.754939467" Jul 27 11:44:50.214733 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:50.214698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd8v9" event={"ID":"6fae44be-49cd-4deb-82d2-090f52be9aa3","Type":"ContainerStarted","Data":"8ea637fcc3f8c17e4124a925819008dea8f640580866d30dfe18fd3cde1e22f8"} Jul 27 11:44:51.120319 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:51.120283 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6x2x" Jul 27 11:44:52.071644 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.071604 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:44:52.074780 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.074712 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.077910 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.077866 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 11:44:52.078158 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.078130 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 11:44:52.078585 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.078441 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 11:44:52.082657 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.082632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 11:44:52.082919 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.082898 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 11:44:52.083040 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.083008 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcfv6\"" Jul 27 11:44:52.086453 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.086433 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:44:52.112077 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.112248 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.112248 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.112363 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112296 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.112416 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112358 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.112416 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.112389 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trmb\" (UniqueName: \"kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213412 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213610 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213451 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213610 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213610 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trmb\" (UniqueName: \"kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213610 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.213610 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.213587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.214746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.214368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.214746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.214368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.214746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.214686 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.219060 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.219036 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.219204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.219176 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.229551 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.229499 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trmb\" (UniqueName: \"kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb\") pod \"console-5cdc8f5c58-lm9pb\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:52.392987 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:52.392950 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:44:53.979462 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:53.979427 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:44:53.983605 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:53.983558 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e42140_098e_4d4e_b768_f752c79df9cf.slice/crio-ccabd14873bb928f68ea9cf582b9b1de7ba31df7199e245733f012b6ea0e9954 WatchSource:0}: Error finding container ccabd14873bb928f68ea9cf582b9b1de7ba31df7199e245733f012b6ea0e9954: Status 404 returned error can't find the container with id ccabd14873bb928f68ea9cf582b9b1de7ba31df7199e245733f012b6ea0e9954 Jul 27 11:44:54.082188 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.082154 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w964z"] Jul 27 11:44:54.084388 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.084364 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.087312 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.087288 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 27 11:44:54.087893 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.087871 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-frp76\"" Jul 27 11:44:54.089524 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.089468 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 27 11:44:54.090379 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.090362 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 27 11:44:54.115555 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.115524 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w964z"] Jul 27 11:44:54.131932 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.131897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee5e004d-b810-4444-aa39-3651b9235857-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.131932 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.131933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.132164 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.131962 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.132164 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.131995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.132164 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.132038 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fnp\" (UniqueName: \"kubernetes.io/projected/ee5e004d-b810-4444-aa39-3651b9235857-kube-api-access-r6fnp\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.132164 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.132073 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.148413 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.148377 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9xxp7"] Jul 27 11:44:54.150530 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.150511 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.153393 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.153369 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kl9gw\"" Jul 27 11:44:54.153519 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.153493 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 11:44:54.153969 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.153947 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 11:44:54.154287 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.154268 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 11:44:54.230741 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.230699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc8f5c58-lm9pb" event={"ID":"17e42140-098e-4d4e-b768-f752c79df9cf","Type":"ContainerStarted","Data":"ccabd14873bb928f68ea9cf582b9b1de7ba31df7199e245733f012b6ea0e9954"} Jul 27 11:44:54.232515 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x8b6\" (UniqueName: \"kubernetes.io/projected/71a1fdfb-5096-4f13-b320-ad8b1d076f08-kube-api-access-2x8b6\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.232681 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-textfile\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.232681 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232561 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.232681 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-wtmp\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.232865 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee5e004d-b810-4444-aa39-3651b9235857-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.232865 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.232865 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.232865 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.232865 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-root\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232874 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fnp\" (UniqueName: \"kubernetes.io/projected/ee5e004d-b810-4444-aa39-3651b9235857-kube-api-access-r6fnp\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:54.232947 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-sys\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.232999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-metrics-client-ca\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.233029 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.233172 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.233111 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee5e004d-b810-4444-aa39-3651b9235857-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.233405 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.233288 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gd8v9" event={"ID":"6fae44be-49cd-4deb-82d2-090f52be9aa3","Type":"ContainerStarted","Data":"cc35160cd3fa9d752c3aeffcf8ec51050f356a03d5e7e8a431362ff46bff3bab"} Jul 27 11:44:54.233715 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.233690 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.233860 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:54.233764 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls podName:ee5e004d-b810-4444-aa39-3651b9235857 nodeName:}" failed. No retries permitted until 2026-07-27 11:44:54.733746903 +0000 UTC m=+64.266097932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-w964z" (UID: "ee5e004d-b810-4444-aa39-3651b9235857") : secret "kube-state-metrics-tls" not found Jul 27 11:44:54.234220 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.234198 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.235785 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.235763 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.250769 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.250745 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fnp\" (UniqueName: \"kubernetes.io/projected/ee5e004d-b810-4444-aa39-3651b9235857-kube-api-access-r6fnp\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.257380 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.257330 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gd8v9" podStartSLOduration=1.4616436099999999 podStartE2EDuration="16.257311584s" totalImagesPullingTime="14.795667974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:44:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:44:54.25605386 +0000 UTC m=+63.788404968" watchObservedRunningTime="2026-07-27 11:44:54.257311584 +0000 UTC m=+63.789662625" Jul 27 11:44:54.334456 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334627 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-wtmp\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334627 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334554 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-root\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-sys\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-root\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334691 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-wtmp\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.334752 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-metrics-client-ca\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334766 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:54.334777 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x8b6\" (UniqueName: \"kubernetes.io/projected/71a1fdfb-5096-4f13-b320-ad8b1d076f08-kube-api-access-2x8b6\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:54.334873 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls podName:71a1fdfb-5096-4f13-b320-ad8b1d076f08 nodeName:}" failed. No retries permitted until 2026-07-27 11:44:54.834854136 +0000 UTC m=+64.367205167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls") pod "node-exporter-9xxp7" (UID: "71a1fdfb-5096-4f13-b320-ad8b1d076f08") : secret "node-exporter-tls" not found Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-textfile\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.334988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71a1fdfb-5096-4f13-b320-ad8b1d076f08-sys\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.335292 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-textfile\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335367 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.335341 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-metrics-client-ca\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.335529 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.335507 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.337240 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.337219 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.344524 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.344506 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x8b6\" (UniqueName: \"kubernetes.io/projected/71a1fdfb-5096-4f13-b320-ad8b1d076f08-kube-api-access-2x8b6\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.739717 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.739625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.742542 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.742483 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee5e004d-b810-4444-aa39-3651b9235857-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-w964z\" (UID: \"ee5e004d-b810-4444-aa39-3651b9235857\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:54.840951 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.840917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.843892 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.843867 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/71a1fdfb-5096-4f13-b320-ad8b1d076f08-node-exporter-tls\") pod \"node-exporter-9xxp7\" (UID: \"71a1fdfb-5096-4f13-b320-ad8b1d076f08\") " pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:54.996103 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:54.996014 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" Jul 27 11:44:55.061096 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:55.060911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xxp7" Jul 27 11:44:55.074090 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:55.074037 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a1fdfb_5096_4f13_b320_ad8b1d076f08.slice/crio-99eb0a5196f984ff1ca5cffce56bb6a1731d5cf99b296931900308b077249bf5 WatchSource:0}: Error finding container 99eb0a5196f984ff1ca5cffce56bb6a1731d5cf99b296931900308b077249bf5: Status 404 returned error can't find the container with id 99eb0a5196f984ff1ca5cffce56bb6a1731d5cf99b296931900308b077249bf5 Jul 27 11:44:55.172987 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:55.172957 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-w964z"] Jul 27 11:44:55.176260 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:44:55.176226 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5e004d_b810_4444_aa39_3651b9235857.slice/crio-94abc7b6085615d4a8685ba4afd87504a604c34a7bfbd102c94d11b321483d6c WatchSource:0}: Error finding container 94abc7b6085615d4a8685ba4afd87504a604c34a7bfbd102c94d11b321483d6c: Status 404 returned error can't find the container with id 94abc7b6085615d4a8685ba4afd87504a604c34a7bfbd102c94d11b321483d6c Jul 27 11:44:55.238769 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:55.238724 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" event={"ID":"ee5e004d-b810-4444-aa39-3651b9235857","Type":"ContainerStarted","Data":"94abc7b6085615d4a8685ba4afd87504a604c34a7bfbd102c94d11b321483d6c"} Jul 27 11:44:55.240211 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:55.240180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xxp7" event={"ID":"71a1fdfb-5096-4f13-b320-ad8b1d076f08","Type":"ContainerStarted","Data":"99eb0a5196f984ff1ca5cffce56bb6a1731d5cf99b296931900308b077249bf5"} Jul 27 11:44:56.199724 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.199690 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4vt7l" Jul 27 11:44:56.658873 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.658835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:56.661204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.661179 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 11:44:56.671905 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.671879 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4baa8c7-13b7-418b-a600-134ae04cec0a-original-pull-secret\") pod \"global-pull-secret-syncer-w4zct\" (UID: \"f4baa8c7-13b7-418b-a600-134ae04cec0a\") " pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:56.759509 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.759461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:56.761884 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.761853 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 11:44:56.772469 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.772443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10597122-4091-4d31-aebb-7c4d33b9dd6d-metrics-certs\") pod \"network-metrics-daemon-tfwxs\" (UID: \"10597122-4091-4d31-aebb-7c4d33b9dd6d\") " pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:56.781383 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.781355 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4zct" Jul 27 11:44:56.860160 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.860131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:56.862748 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.862717 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 11:44:56.873150 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.873125 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 11:44:56.884187 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:56.884155 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97q4\" (UniqueName: \"kubernetes.io/projected/24088e29-a051-4fa2-bd46-d04ab5187a0c-kube-api-access-f97q4\") pod \"network-check-target-x5dcr\" (UID: \"24088e29-a051-4fa2-bd46-d04ab5187a0c\") " pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:57.069601 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:57.069511 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prgdb\"" Jul 27 11:44:57.077634 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:57.077612 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfwxs" Jul 27 11:44:57.092074 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:57.092050 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpzsp\"" Jul 27 11:44:57.100177 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:57.100154 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:44:58.428250 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.428214 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-867577d5b-wt8lm"] Jul 27 11:44:58.462305 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.462271 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-867577d5b-wt8lm"] Jul 27 11:44:58.462488 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.462405 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.465963 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.465936 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 11:44:58.466196 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.466182 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g6p8q\"" Jul 27 11:44:58.467228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.467209 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 11:44:58.467308 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.467286 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 11:44:58.467480 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.467461 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 11:44:58.467631 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.467614 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ed4qjuvn4q271\"" Jul 27 11:44:58.574972 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.574939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a7bca19-e8a2-4497-ba56-b1ca951484d3-audit-log\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.574972 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.574986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-metrics-server-audit-profiles\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.575216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.575019 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-tls\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.575216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.575090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-client-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.575216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.575163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-client-certs\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.575362 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.575219 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9nr\" (UniqueName: \"kubernetes.io/projected/8a7bca19-e8a2-4497-ba56-b1ca951484d3-kube-api-access-4q9nr\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.575362 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.575297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.676732 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.676686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a7bca19-e8a2-4497-ba56-b1ca951484d3-audit-log\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.676732 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.676737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-metrics-server-audit-profiles\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.676982 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.676892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-tls\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.676982 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.676940 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-client-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.676982 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.676974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-client-certs\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.677130 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.677035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9nr\" (UniqueName: \"kubernetes.io/projected/8a7bca19-e8a2-4497-ba56-b1ca951484d3-kube-api-access-4q9nr\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.677130 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.677092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.677835 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.677235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8a7bca19-e8a2-4497-ba56-b1ca951484d3-audit-log\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.677976 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.677823 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.677976 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.677957 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8a7bca19-e8a2-4497-ba56-b1ca951484d3-metrics-server-audit-profiles\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.680151 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.680082 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-tls\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.680151 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.680115 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-secret-metrics-server-client-certs\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.680290 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.680199 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a7bca19-e8a2-4497-ba56-b1ca951484d3-client-ca-bundle\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.686467 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.686436 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9nr\" (UniqueName: \"kubernetes.io/projected/8a7bca19-e8a2-4497-ba56-b1ca951484d3-kube-api-access-4q9nr\") pod \"metrics-server-867577d5b-wt8lm\" (UID: \"8a7bca19-e8a2-4497-ba56-b1ca951484d3\") " pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.773586 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.773552 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:44:58.803288 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.803259 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cb552"] Jul 27 11:44:58.820748 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.820703 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cb552"] Jul 27 11:44:58.820937 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.820866 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:58.823379 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.823353 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 11:44:58.823567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.823549 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cscgn\"" Jul 27 11:44:58.878479 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.878442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gm2z\" (UniqueName: \"kubernetes.io/projected/4c342b42-3fbb-416a-9da5-931f4e33e540-kube-api-access-2gm2z\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:58.878684 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.878499 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:58.979213 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.979120 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gm2z\" (UniqueName: \"kubernetes.io/projected/4c342b42-3fbb-416a-9da5-931f4e33e540-kube-api-access-2gm2z\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:58.979213 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.979202 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:58.979453 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:58.979311 2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 11:44:58.979453 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:44:58.979400 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert podName:4c342b42-3fbb-416a-9da5-931f4e33e540 nodeName:}" failed. No retries permitted until 2026-07-27 11:44:59.479375171 +0000 UTC m=+69.011726199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-cb552" (UID: "4c342b42-3fbb-416a-9da5-931f4e33e540") : secret "monitoring-plugin-cert" not found Jul 27 11:44:58.987519 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:58.987489 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gm2z\" (UniqueName: \"kubernetes.io/projected/4c342b42-3fbb-416a-9da5-931f4e33e540-kube-api-access-2gm2z\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:59.483551 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:59.483509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:59.486344 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:59.486313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c342b42-3fbb-416a-9da5-931f4e33e540-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cb552\" (UID: \"4c342b42-3fbb-416a-9da5-931f4e33e540\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:44:59.732385 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:44:59.732354 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:45:00.228632 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.228590 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:45:00.232554 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.232528 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.236029 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.235966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 11:45:00.236367 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.236322 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.237963 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238036 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238178 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.237963 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qwmt9\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238386 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 11:45:00.238567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238423 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 11:45:00.239075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238622 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8n1mu46npjngg\"" Jul 27 11:45:00.239075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238717 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 11:45:00.239075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238820 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 11:45:00.239075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.238916 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 11:45:00.239251 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.239125 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 11:45:00.241166 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.240999 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 11:45:00.242828 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.242484 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 11:45:00.244432 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.244407 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 11:45:00.261853 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.261822 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:45:00.291384 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291229 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291384 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291270 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqhpr\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291384 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291296 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291384 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291326 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291387 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291478 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291538 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291590 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291621 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291695 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.291746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291874 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291956 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.291991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.292175 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.292065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393191 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393302 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393328 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.393382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393462 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393537 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393583 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393639 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqhpr\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393691 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.393720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.394117 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.394159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.394685 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398021 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.394707 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.396889 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.397629 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.397693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.398111 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.398184 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.398460 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.398968 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.398712 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.399309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.399220 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.400669 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.400643 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.401756 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.401320 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.401756 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.401708 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.401958 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.401853 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.402228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.402194 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.402523 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.402428 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.402734 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.402712 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.405925 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.405899 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqhpr\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr\") pod \"prometheus-k8s-0\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:00.547801 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:00.547702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:05.617113 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.616559 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4zct"] Jul 27 11:45:05.698674 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.698627 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5dcr"] Jul 27 11:45:05.715936 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.715905 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cb552"] Jul 27 11:45:05.716554 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.716505 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tfwxs"] Jul 27 11:45:05.720096 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.719565 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:45:05.727007 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:45:05.726952 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c342b42_3fbb_416a_9da5_931f4e33e540.slice/crio-761c22d8a77095aa8ff663ef1419faa807d3f1991690f65992f430fdb39795c5 WatchSource:0}: Error finding container 761c22d8a77095aa8ff663ef1419faa807d3f1991690f65992f430fdb39795c5: Status 404 returned error can't find the container with id 761c22d8a77095aa8ff663ef1419faa807d3f1991690f65992f430fdb39795c5 Jul 27 11:45:05.734374 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:05.734248 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-867577d5b-wt8lm"] Jul 27 11:45:05.747602 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:45:05.747459 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7bca19_e8a2_4497_ba56_b1ca951484d3.slice/crio-bd3eb9d5548452807f83950a525a4a38457944c33cb0cfd304c7edc7029ee5d0 WatchSource:0}: Error finding container bd3eb9d5548452807f83950a525a4a38457944c33cb0cfd304c7edc7029ee5d0: Status 404 returned error can't find the container with id bd3eb9d5548452807f83950a525a4a38457944c33cb0cfd304c7edc7029ee5d0 Jul 27 11:45:06.292042 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.289148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z6kjs" event={"ID":"e04ea2c4-17b8-4df2-8fa2-07227aea9b41","Type":"ContainerStarted","Data":"040923a5f067e4dfad1f296aff65b40db711f74c69eacee60c922ab5a7877891"} Jul 27 11:45:06.292042 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.291860 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:45:06.298322 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.297703 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc8f5c58-lm9pb" event={"ID":"17e42140-098e-4d4e-b768-f752c79df9cf","Type":"ContainerStarted","Data":"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6"} Jul 27 11:45:06.300908 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.300855 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-z6kjs" Jul 27 11:45:06.309619 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.308874 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-z6kjs" podStartSLOduration=5.555877697 podStartE2EDuration="25.308854094s" totalImagesPullingTime="19.752976397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:06.30767488 +0000 UTC m=+75.840025952" watchObservedRunningTime="2026-07-27 11:45:06.308854094 +0000 UTC m=+75.841205143" Jul 27 11:45:06.316325 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.316281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" event={"ID":"4c342b42-3fbb-416a-9da5-931f4e33e540","Type":"ContainerStarted","Data":"761c22d8a77095aa8ff663ef1419faa807d3f1991690f65992f430fdb39795c5"} Jul 27 11:45:06.319975 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.319894 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfwxs" event={"ID":"10597122-4091-4d31-aebb-7c4d33b9dd6d","Type":"ContainerStarted","Data":"4e8d0e5e44101047829e8f92945ecb5845a67e440389b20dd9259632e520fad0"} Jul 27 11:45:06.336390 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.336354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4zct" event={"ID":"f4baa8c7-13b7-418b-a600-134ae04cec0a","Type":"ContainerStarted","Data":"ef2db842c96fbf4f165fba06486bc5c68cfa3649790ec6dd788ac9787e8a8741"} Jul 27 11:45:06.345125 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.344932 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cdc8f5c58-lm9pb" podStartSLOduration=3.024535039 podStartE2EDuration="14.344909954s" totalImagesPullingTime="11.320374915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:06.343330139 +0000 UTC m=+75.875681187" watchObservedRunningTime="2026-07-27 11:45:06.344909954 +0000 UTC m=+75.877261006" Jul 27 11:45:06.347832 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.346854 2583 generic.go:356] "Generic (PLEG): container finished" podID="71a1fdfb-5096-4f13-b320-ad8b1d076f08" containerID="20609f691400f92524b52ade9c4431c4fbb31eda785e3ec57dd0df1055bda51c" exitCode=0 Jul 27 11:45:06.347832 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.346931 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xxp7" event={"ID":"71a1fdfb-5096-4f13-b320-ad8b1d076f08","Type":"ContainerDied","Data":"20609f691400f92524b52ade9c4431c4fbb31eda785e3ec57dd0df1055bda51c"} Jul 27 11:45:06.361878 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.361845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" event={"ID":"8a7bca19-e8a2-4497-ba56-b1ca951484d3","Type":"ContainerStarted","Data":"bd3eb9d5548452807f83950a525a4a38457944c33cb0cfd304c7edc7029ee5d0"} Jul 27 11:45:06.379163 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.374577 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" event={"ID":"ee5e004d-b810-4444-aa39-3651b9235857","Type":"ContainerStarted","Data":"08229561c03fa375087bcc44bacf3d1bbc7eaefbfc25b5c85586503f1fb54f86"} Jul 27 11:45:06.379163 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.374689 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" event={"ID":"ee5e004d-b810-4444-aa39-3651b9235857","Type":"ContainerStarted","Data":"c9f7c2a8f875c5a01b0fdb12e9fb7d96d2c1a3d6bcbb619d3cc51509098eb4cf"} Jul 27 11:45:06.379163 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.374721 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" event={"ID":"ee5e004d-b810-4444-aa39-3651b9235857","Type":"ContainerStarted","Data":"28081d2e9262c8029424a24f9f74878150ccb3e15ef3d97985c997eb556a4ae5"} Jul 27 11:45:06.380738 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.380564 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"bdbbeb3d33b0d3e0e27c7c1cdc880eef77056bb7905656ad8f44e7d2e8e2ea37"} Jul 27 11:45:06.385839 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.385754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5dcr" event={"ID":"24088e29-a051-4fa2-bd46-d04ab5187a0c","Type":"ContainerStarted","Data":"fc9864eef8c3a6d1639877496ea8175677c0465f39950e070e0e8ec2e491d807"} Jul 27 11:45:06.397668 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:06.397468 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-w964z" podStartSLOduration=2.270123878 podStartE2EDuration="12.39742513s" totalImagesPullingTime="10.127301252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:06.393361029 +0000 UTC m=+75.925712108" watchObservedRunningTime="2026-07-27 11:45:06.39742513 +0000 UTC m=+75.929776183" Jul 27 11:45:07.402923 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:07.401580 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xxp7" event={"ID":"71a1fdfb-5096-4f13-b320-ad8b1d076f08","Type":"ContainerStarted","Data":"440ebe31345da9a2d9fd5498e5ee722496e421a3193408df30918bf8a2e79bc8"} Jul 27 11:45:07.402923 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:07.401670 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xxp7" event={"ID":"71a1fdfb-5096-4f13-b320-ad8b1d076f08","Type":"ContainerStarted","Data":"7d7fe5968878f0ad0bce41f945984dc1d4b9e6743cb48e6588c2d9d5c22321d4"} Jul 27 11:45:07.423051 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:07.421517 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9xxp7" podStartSLOduration=2.965700874 podStartE2EDuration="13.42149531s" totalImagesPullingTime="10.230528966s" totalInitContainerRuntime="225.26547ms" isStatefulPod=true podCreationTimestamp="2026-07-27 11:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:07.4206921 +0000 UTC m=+76.953043148" watchObservedRunningTime="2026-07-27 11:45:07.42149531 +0000 UTC m=+76.953846358" Jul 27 11:45:11.034075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:11.034036 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:45:12.393899 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:12.393863 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:45:15.440657 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.440624 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" exitCode=0 Jul 27 11:45:15.440960 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.440728 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} Jul 27 11:45:15.443407 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.443324 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" event={"ID":"4c342b42-3fbb-416a-9da5-931f4e33e540","Type":"ContainerStarted","Data":"3a1705130b261b4182c1cf546d62efe30d8ff981180538d7e0e909ee0dd0a821"} Jul 27 11:45:15.445048 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.445021 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfwxs" event={"ID":"10597122-4091-4d31-aebb-7c4d33b9dd6d","Type":"ContainerStarted","Data":"d724f2b44683ee98223714b643157f842695f4124c47d9361e9eca1307347471"} Jul 27 11:45:15.454532 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.454463 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:45:15.461122 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.461082 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" Jul 27 11:45:15.491457 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:15.491402 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cb552" podStartSLOduration=8.005843673 podStartE2EDuration="17.491382466s" totalImagesPullingTime="9.485538793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:15.491184709 +0000 UTC m=+85.023535757" watchObservedRunningTime="2026-07-27 11:45:15.491382466 +0000 UTC m=+85.023733514" Jul 27 11:45:16.454732 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.454645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfwxs" event={"ID":"10597122-4091-4d31-aebb-7c4d33b9dd6d","Type":"ContainerStarted","Data":"cc8fdbb1aea35fb9b9cd079b9909009ff812004f2ec4605d1c599201e2537c71"} Jul 27 11:45:16.456394 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.456363 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4zct" event={"ID":"f4baa8c7-13b7-418b-a600-134ae04cec0a","Type":"ContainerStarted","Data":"f71d3de670238a5909b773b41c2ec5191bfd4111da41f1a37befeb2684257758"} Jul 27 11:45:16.458025 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.457999 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" event={"ID":"8a7bca19-e8a2-4497-ba56-b1ca951484d3","Type":"ContainerStarted","Data":"cb26a5736f095ec3d37905f0ab244d7d4358067294b8986fc8c7bf92bc6e75aa"} Jul 27 11:45:16.459648 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.459619 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5dcr" event={"ID":"24088e29-a051-4fa2-bd46-d04ab5187a0c","Type":"ContainerStarted","Data":"c481d2c98e6725836a3edda4eda59c9ca1e27794b35f7cacc1871c41788c30ff"} Jul 27 11:45:16.471731 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.471680 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tfwxs" podStartSLOduration=75.991121115 podStartE2EDuration="1m25.471659966s" totalImagesPullingTime="9.480538851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:16.470186155 +0000 UTC m=+86.002537204" watchObservedRunningTime="2026-07-27 11:45:16.471659966 +0000 UTC m=+86.004011016" Jul 27 11:45:16.491146 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.491055 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5dcr" podStartSLOduration=75.9656647 podStartE2EDuration="1m25.491033861s" totalImagesPullingTime="9.525369161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:16.490399599 +0000 UTC m=+86.022750648" watchObservedRunningTime="2026-07-27 11:45:16.491033861 +0000 UTC m=+86.023384914" Jul 27 11:45:16.507816 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.507742 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w4zct" podStartSLOduration=75.930132622 podStartE2EDuration="1m25.507724564s" totalImagesPullingTime="9.577591942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:16.507424195 +0000 UTC m=+86.039775265" watchObservedRunningTime="2026-07-27 11:45:16.507724564 +0000 UTC m=+86.040075612" Jul 27 11:45:16.527921 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:16.527865 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" podStartSLOduration=9.056279431 podStartE2EDuration="18.527848169s" totalImagesPullingTime="9.471568738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:16.526774806 +0000 UTC m=+86.059125878" watchObservedRunningTime="2026-07-27 11:45:16.527848169 +0000 UTC m=+86.060199216" Jul 27 11:45:17.465227 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:17.465196 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:45:18.773914 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:18.773878 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:45:18.774387 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:18.773994 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:45:19.475153 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:19.475111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} Jul 27 11:45:19.475382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:19.475197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} Jul 27 11:45:22.490305 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:22.490271 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} Jul 27 11:45:22.490722 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:22.490364 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} Jul 27 11:45:22.490722 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:22.490390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} Jul 27 11:45:22.490722 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:22.490415 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerStarted","Data":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} Jul 27 11:45:22.521581 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:22.521532 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.941030592 podStartE2EDuration="22.52151572s" totalImagesPullingTime="15.560328476s" totalInitContainerRuntime="20.156652ms" isStatefulPod=false podCreationTimestamp="2026-07-27 11:45:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:45:22.519250384 +0000 UTC m=+92.051601432" watchObservedRunningTime="2026-07-27 11:45:22.52151572 +0000 UTC m=+92.053866823" Jul 27 11:45:25.547880 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:25.547842 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:45:33.475139 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:33.475111 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84xbl_36774873-2f15-49c9-ad8d-fa432c79ede5/serve-healthcheck-canary/0.log" Jul 27 11:45:36.058680 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.058628 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cdc8f5c58-lm9pb" podUID="17e42140-098e-4d4e-b768-f752c79df9cf" containerName="console" containerID="cri-o://f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6" gracePeriod=15 Jul 27 11:45:36.331525 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.331456 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:45:36.404008 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.403974 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404008 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404005 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404253 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404056 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404253 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404085 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404253 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404117 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404253 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404134 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9trmb\" (UniqueName: \"kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb\") pod \"17e42140-098e-4d4e-b768-f752c79df9cf\" (UID: \"17e42140-098e-4d4e-b768-f752c79df9cf\") " Jul 27 11:45:36.404478 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404451 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:45:36.404478 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404462 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config" (OuterVolumeSpecName: "console-config") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:45:36.404598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.404496 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:45:36.406451 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.406423 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:45:36.406563 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.406525 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:45:36.406619 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.406561 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb" (OuterVolumeSpecName: "kube-api-access-9trmb") pod "17e42140-098e-4d4e-b768-f752c79df9cf" (UID: "17e42140-098e-4d4e-b768-f752c79df9cf"). InnerVolumeSpecName "kube-api-access-9trmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:45:36.504983 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.504944 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-serving-cert\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.504983 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.504972 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-service-ca\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.504983 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.504982 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e42140-098e-4d4e-b768-f752c79df9cf-console-oauth-config\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.504983 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.504990 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9trmb\" (UniqueName: \"kubernetes.io/projected/17e42140-098e-4d4e-b768-f752c79df9cf-kube-api-access-9trmb\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.505242 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.505002 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-oauth-serving-cert\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.505242 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.505010 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e42140-098e-4d4e-b768-f752c79df9cf-console-config\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:45:36.544059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.544024 2583 generic.go:356] "Generic (PLEG): container finished" podID="17e42140-098e-4d4e-b768-f752c79df9cf" containerID="f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6" exitCode=0 Jul 27 11:45:36.544201 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.544107 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc8f5c58-lm9pb" Jul 27 11:45:36.544201 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.544114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc8f5c58-lm9pb" event={"ID":"17e42140-098e-4d4e-b768-f752c79df9cf","Type":"ContainerDied","Data":"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6"} Jul 27 11:45:36.544274 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.544204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc8f5c58-lm9pb" event={"ID":"17e42140-098e-4d4e-b768-f752c79df9cf","Type":"ContainerDied","Data":"ccabd14873bb928f68ea9cf582b9b1de7ba31df7199e245733f012b6ea0e9954"} Jul 27 11:45:36.544274 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.544228 2583 scope.go:117] "RemoveContainer" containerID="f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6" Jul 27 11:45:36.552958 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.552933 2583 scope.go:117] "RemoveContainer" containerID="f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6" Jul 27 11:45:36.553248 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:45:36.553229 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6\": container with ID starting with f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6 not found: ID does not exist" containerID="f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6" Jul 27 11:45:36.553311 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.553257 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6"} err="failed to get container status \"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6\": rpc error: code = NotFound desc = could not find container \"f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6\": container with ID starting with f2383713456341db082810b1f1327e9771110414d2d30e4ac71400ae0320bab6 not found: ID does not exist" Jul 27 11:45:36.564045 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.564018 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:45:36.570510 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.570486 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cdc8f5c58-lm9pb"] Jul 27 11:45:36.954707 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:36.954677 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e42140-098e-4d4e-b768-f752c79df9cf" path="/var/lib/kubelet/pods/17e42140-098e-4d4e-b768-f752c79df9cf/volumes" Jul 27 11:45:38.779728 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:38.779700 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:45:38.783406 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:38.783379 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-867577d5b-wt8lm" Jul 27 11:45:48.472526 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:45:48.472493 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5dcr" Jul 27 11:46:00.548361 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:00.548327 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:00.628730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:00.628697 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:00.647335 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:00.647312 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:18.599682 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.599646 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:18.600144 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.599980 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="prometheus" containerID="cri-o://d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" gracePeriod=600 Jul 27 11:46:18.600144 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.600061 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-web" containerID="cri-o://263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" gracePeriod=600 Jul 27 11:46:18.600144 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.600016 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy" containerID="cri-o://05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" gracePeriod=600 Jul 27 11:46:18.600144 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.600082 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="thanos-sidecar" containerID="cri-o://e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" gracePeriod=600 Jul 27 11:46:18.600387 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.600111 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" gracePeriod=600 Jul 27 11:46:18.600387 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.600279 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="config-reloader" containerID="cri-o://81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" gracePeriod=600 Jul 27 11:46:18.862057 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.862032 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:18.944189 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944161 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944189 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944192 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944425 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944215 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944425 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944252 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944425 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944394 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944447 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944480 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqhpr\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944506 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944537 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944583 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944564 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944601 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944608 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944632 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944655 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944678 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944689 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944724 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944761 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944826 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.944870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944852 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944891 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944913 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls\") pod \"d1d088e3-054b-4ebc-904c-75090a7d166a\" (UID: \"d1d088e3-054b-4ebc-904c-75090a7d166a\") " Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.944966 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945165 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945180 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-metrics-client-ca\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:18.945333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945195 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:18.945668 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945524 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.945668 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945534 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.945668 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.945589 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 11:46:18.947313 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.947135 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.947710 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.947543 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.947849 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.947749 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.948050 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.947948 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.948322 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.948221 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.948412 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.948381 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:46:18.948604 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.948522 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.949031 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.948939 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config" (OuterVolumeSpecName: "config") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.949190 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.949160 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.949786 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.949747 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:18.950344 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.950318 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr" (OuterVolumeSpecName: "kube-api-access-tqhpr") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "kube-api-access-tqhpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:46:18.950677 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.950586 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out" (OuterVolumeSpecName: "config-out") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 11:46:18.950909 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.950881 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:46:18.960216 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:18.960192 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config" (OuterVolumeSpecName: "web-config") pod "d1d088e3-054b-4ebc-904c-75090a7d166a" (UID: "d1d088e3-054b-4ebc-904c-75090a7d166a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:46:19.045975 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.045940 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.045975 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.045969 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.045975 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.045980 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-web-config\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.045988 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.045997 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046006 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-grpc-tls\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046014 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-metrics-client-certs\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046024 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046033 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046042 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046050 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqhpr\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-kube-api-access-tqhpr\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046058 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-prometheus-k8s-db\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046067 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-secret-kube-rbac-proxy\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046075 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046085 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d088e3-054b-4ebc-904c-75090a7d166a-config\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046092 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d088e3-054b-4ebc-904c-75090a7d166a-config-out\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.046195 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.046100 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d088e3-054b-4ebc-904c-75090a7d166a-tls-assets\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:46:19.701415 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701382 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" exitCode=0 Jul 27 11:46:19.701415 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701410 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" exitCode=0 Jul 27 11:46:19.701415 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701419 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" exitCode=0 Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701427 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" exitCode=0 Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701434 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" exitCode=0 Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701441 2583 generic.go:356] "Generic (PLEG): container finished" podID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" exitCode=0 Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701461 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701461 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701549 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701595 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701636 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701620 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701679 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701721 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} Jul 27 11:46:19.701926 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.701764 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d088e3-054b-4ebc-904c-75090a7d166a","Type":"ContainerDied","Data":"bdbbeb3d33b0d3e0e27c7c1cdc880eef77056bb7905656ad8f44e7d2e8e2ea37"} Jul 27 11:46:19.709521 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.709447 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.716101 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.716084 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.723046 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.723029 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.725331 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.725310 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:19.730323 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.730306 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.732197 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.732177 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:19.738564 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.738542 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.745810 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.745771 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.752564 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.752549 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.752888 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.752868 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.752940 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.752896 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.752940 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.752916 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.753185 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.753163 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.753267 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753198 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.753267 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753223 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.753491 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.753475 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.753528 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753497 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.753528 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753521 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.753749 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.753732 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.753813 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753762 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.753813 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.753779 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.754040 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.754022 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.754108 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754046 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.754108 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754066 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.754319 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.754301 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.754366 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754323 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.754366 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754337 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.754540 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:46:19.754524 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.754601 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754547 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.754601 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754566 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.754777 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754761 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.754870 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.754779 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.755031 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755014 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.755090 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755033 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.755228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755211 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.755294 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755229 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.755428 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755412 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.755491 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755428 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.755611 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755595 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.755674 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755612 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.755854 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755837 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.755904 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.755855 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.756071 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756051 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.756114 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756073 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.756419 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756386 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.756672 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756501 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.756848 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756821 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.756944 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.756851 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.757135 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757111 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.757201 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757138 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.757445 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757423 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.757511 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757448 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.757730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757708 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.757730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.757728 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.758034 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758016 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.758034 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758034 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.758245 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758227 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:19.758291 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758249 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.758291 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758265 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.758516 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758490 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758507 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758522 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-thanos" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758535 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-thanos" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758550 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e42140-098e-4d4e-b768-f752c79df9cf" containerName="console" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758556 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e42140-098e-4d4e-b768-f752c79df9cf" containerName="console" Jul 27 11:46:19.758565 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758563 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="init-config-reloader" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758569 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="init-config-reloader" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758575 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="config-reloader" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758581 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="config-reloader" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758588 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="thanos-sidecar" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758594 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="thanos-sidecar" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758600 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758605 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758614 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="prometheus" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758619 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="prometheus" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758624 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-web" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758631 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-web" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758681 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-thanos" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758692 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="config-reloader" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758700 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758706 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e42140-098e-4d4e-b768-f752c79df9cf" containerName="console" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758711 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="kube-rbac-proxy-web" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758717 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="prometheus" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758723 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" containerName="thanos-sidecar" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758750 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.758823 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758767 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.758990 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759005 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759227 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759243 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759432 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.759463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759447 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.759675 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759658 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.759675 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759672 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.759951 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759903 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.760056 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.759952 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.760235 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760217 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.760290 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760236 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.760527 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760501 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.760527 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760525 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.760778 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760755 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.760872 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.760784 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.761030 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761007 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.761030 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761028 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.761287 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761267 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.761343 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761290 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.761647 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761625 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.761647 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761647 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.761942 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761921 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.761942 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.761943 2583 scope.go:117] "RemoveContainer" containerID="25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb" Jul 27 11:46:19.762088 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762044 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.762149 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762132 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb"} err="failed to get container status \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": rpc error: code = NotFound desc = could not find container \"25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb\": container with ID starting with 25b4624e1ae8b3068f8ddc1441ec66c728c5bcace6eb294a7f3dd25b60ed4afb not found: ID does not exist" Jul 27 11:46:19.762191 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762152 2583 scope.go:117] "RemoveContainer" containerID="05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212" Jul 27 11:46:19.762526 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762359 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212"} err="failed to get container status \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": rpc error: code = NotFound desc = could not find container \"05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212\": container with ID starting with 05e882b6f7e505f408e3980ef707833d7ff2464c0d2cfe9a81a0b289ef181212 not found: ID does not exist" Jul 27 11:46:19.762526 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762384 2583 scope.go:117] "RemoveContainer" containerID="263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a" Jul 27 11:46:19.762688 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762597 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a"} err="failed to get container status \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": rpc error: code = NotFound desc = could not find container \"263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a\": container with ID starting with 263e76cf23b82647fdc690cea8632d811739e8b92b9577ac3ba3edc659ed639a not found: ID does not exist" Jul 27 11:46:19.762688 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762614 2583 scope.go:117] "RemoveContainer" containerID="e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee" Jul 27 11:46:19.762871 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762852 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee"} err="failed to get container status \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": rpc error: code = NotFound desc = could not find container \"e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee\": container with ID starting with e43aa67cff2bc58f3152c426ae609a305b73d45fb8e7bdfbc2ba8a003bb8eeee not found: ID does not exist" Jul 27 11:46:19.762924 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.762873 2583 scope.go:117] "RemoveContainer" containerID="81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6" Jul 27 11:46:19.763123 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.763107 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6"} err="failed to get container status \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": rpc error: code = NotFound desc = could not find container \"81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6\": container with ID starting with 81bb34d3c235fa441812b851308a640b574271a37fd1c2756ab59389af0b45a6 not found: ID does not exist" Jul 27 11:46:19.763167 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.763123 2583 scope.go:117] "RemoveContainer" containerID="d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94" Jul 27 11:46:19.763324 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.763309 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94"} err="failed to get container status \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": rpc error: code = NotFound desc = could not find container \"d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94\": container with ID starting with d95263b29635104e09671ea09a3b4387e4faef519e0b668e0cde2cd8a706ae94 not found: ID does not exist" Jul 27 11:46:19.763373 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.763324 2583 scope.go:117] "RemoveContainer" containerID="c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf" Jul 27 11:46:19.763541 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.763522 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf"} err="failed to get container status \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": rpc error: code = NotFound desc = could not find container \"c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf\": container with ID starting with c2fe61353f9e6f336e9ccb26558296bb4bc0ec3184ed7e294c309042d9f936bf not found: ID does not exist" Jul 27 11:46:19.764730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.764709 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qwmt9\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.765467 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.765575 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.765724 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.766864 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.766985 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 11:46:19.767278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.767147 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.767350 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.767811 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.768450 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.768680 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.768717 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.769009 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 11:46:19.771218 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.769310 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8n1mu46npjngg\"" Jul 27 11:46:19.773009 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.772990 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 11:46:19.774314 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.774298 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 11:46:19.780887 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.780867 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:19.852786 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.852953 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852817 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.852953 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852841 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.852953 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852862 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.852953 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852882 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.852978 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853057 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853082 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853229 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853229 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853229 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853229 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853194 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853229 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853212 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvwk\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-kube-api-access-swvwk\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853368 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853247 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853368 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853264 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853368 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853368 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.853368 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.853339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954094 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954010 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954094 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954094 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954088 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954120 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954295 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954278 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954307 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954473 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swvwk\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-kube-api-access-swvwk\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954536 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.954635 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.955147 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954880 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.955147 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.954897 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.955254 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.955217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.955312 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.955249 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.956873 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.955960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.956873 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.956548 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.957202 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.957180 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.957808 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.957767 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.957908 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.957782 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.958097 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.957988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.958097 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.958082 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.958266 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.958243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.958683 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.958338 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.958683 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.958643 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-config\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.959620 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.959587 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.959940 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.959921 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.960287 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.960267 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.960360 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.960307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.960730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.960710 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:19.963651 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:19.963633 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvwk\" (UniqueName: \"kubernetes.io/projected/8c66cfd0-19e4-4ef4-bbf1-0db0435b424c-kube-api-access-swvwk\") pod \"prometheus-k8s-0\" (UID: \"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:20.074923 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.074871 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:46:20.205260 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.205236 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 11:46:20.207519 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:46:20.207498 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c66cfd0_19e4_4ef4_bbf1_0db0435b424c.slice/crio-a7954c87db7b099341b86a9efc3375b218ab30d363a3c6dc28e651a2348eafb4 WatchSource:0}: Error finding container a7954c87db7b099341b86a9efc3375b218ab30d363a3c6dc28e651a2348eafb4: Status 404 returned error can't find the container with id a7954c87db7b099341b86a9efc3375b218ab30d363a3c6dc28e651a2348eafb4 Jul 27 11:46:20.707240 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.707204 2583 generic.go:356] "Generic (PLEG): container finished" podID="8c66cfd0-19e4-4ef4-bbf1-0db0435b424c" containerID="65c4d7ed397a01bf66d6e882711e79d006fdb70ab454f83b3e3739156c7c82c2" exitCode=0 Jul 27 11:46:20.707606 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.707294 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerDied","Data":"65c4d7ed397a01bf66d6e882711e79d006fdb70ab454f83b3e3739156c7c82c2"} Jul 27 11:46:20.707606 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.707354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"a7954c87db7b099341b86a9efc3375b218ab30d363a3c6dc28e651a2348eafb4"} Jul 27 11:46:20.958776 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:20.958074 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d088e3-054b-4ebc-904c-75090a7d166a" path="/var/lib/kubelet/pods/d1d088e3-054b-4ebc-904c-75090a7d166a/volumes" Jul 27 11:46:21.714379 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"5644d6f6719e71f63be0f93de9a6230da6765953c4e36852ee10f8125c464be8"} Jul 27 11:46:21.714857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714423 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"1f4469b3979be5c6bdf4243e9147b65fd285494791edc7efffd2299f8827e91c"} Jul 27 11:46:21.714857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"98077c0e622341e844a05bcac17b0d4d8d2f5d2dc83936232d9b5bb89ef0ca9d"} Jul 27 11:46:21.714857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714503 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"38dc136e2a5b933ff02b59812675752c8e3728e1bf25899c9ad31a56d07f647d"} Jul 27 11:46:21.714857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714539 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"3d778f3f1e8951c7f7e5721a509f1079c459d406f8ba91870a7c21e3514f7d67"} Jul 27 11:46:21.714857 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.714574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c66cfd0-19e4-4ef4-bbf1-0db0435b424c","Type":"ContainerStarted","Data":"decf5a93cc56d07646b4636b5eb0b2c865d5ba278311368266f062ac8217cd5a"} Jul 27 11:46:21.743429 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:21.743373 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.719834672 podStartE2EDuration="2.743355512s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.52084ms" isStatefulPod=false podCreationTimestamp="2026-07-27 11:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:46:21.741968769 +0000 UTC m=+151.274319815" watchObservedRunningTime="2026-07-27 11:46:21.743355512 +0000 UTC m=+151.275706561" Jul 27 11:46:25.075884 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:46:25.075836 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:47:20.075256 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:47:20.075202 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:47:20.090196 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:47:20.090167 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:47:20.946581 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:47:20.946546 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 11:48:50.831895 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:48:50.830112 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 11:49:30.012956 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.012923 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-88cs9"] Jul 27 11:49:30.016095 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.016079 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.019841 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.019819 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qdszw\"" Jul 27 11:49:30.019841 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.019836 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 11:49:30.020589 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.020575 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 11:49:30.038481 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.038461 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-88cs9"] Jul 27 11:49:30.206628 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.206593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfd2f\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-kube-api-access-kfd2f\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.206628 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.206633 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-bound-sa-token\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.307730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.307649 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfd2f\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-kube-api-access-kfd2f\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.307730 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.307688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-bound-sa-token\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.316149 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.316116 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-bound-sa-token\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.316296 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.316259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfd2f\" (UniqueName: \"kubernetes.io/projected/7363d44f-c6b8-43ee-94d3-8e44b28f137b-kube-api-access-kfd2f\") pod \"cert-manager-55b4d954d5-88cs9\" (UID: \"7363d44f-c6b8-43ee-94d3-8e44b28f137b\") " pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.335096 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.335074 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-88cs9" Jul 27 11:49:30.465430 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.465397 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-88cs9"] Jul 27 11:49:30.468320 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:49:30.468297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7363d44f_c6b8_43ee_94d3_8e44b28f137b.slice/crio-c6af102e05c350c81ec89e627eb929e1c89ca1611fcbc809d18256e42f151a3b WatchSource:0}: Error finding container c6af102e05c350c81ec89e627eb929e1c89ca1611fcbc809d18256e42f151a3b: Status 404 returned error can't find the container with id c6af102e05c350c81ec89e627eb929e1c89ca1611fcbc809d18256e42f151a3b Jul 27 11:49:30.470225 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:30.470212 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 11:49:31.369852 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:31.369821 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-88cs9" event={"ID":"7363d44f-c6b8-43ee-94d3-8e44b28f137b","Type":"ContainerStarted","Data":"c6af102e05c350c81ec89e627eb929e1c89ca1611fcbc809d18256e42f151a3b"} Jul 27 11:49:34.383415 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:34.383377 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-88cs9" event={"ID":"7363d44f-c6b8-43ee-94d3-8e44b28f137b","Type":"ContainerStarted","Data":"dcf0d3a9238fe4b82bafca6405bd6e958dc422589c0c678823f14ea87833e120"} Jul 27 11:49:34.402901 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:49:34.402850 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-88cs9" podStartSLOduration=2.096407318 podStartE2EDuration="5.402831806s" totalImagesPullingTime="3.306424488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:49:34.402542066 +0000 UTC m=+343.934893114" watchObservedRunningTime="2026-07-27 11:49:34.402831806 +0000 UTC m=+343.935182854" Jul 27 11:50:54.104288 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.104256 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm"] Jul 27 11:50:54.107362 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.107346 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.109901 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.109879 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-w7kzt\"" Jul 27 11:50:54.110045 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.109882 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 27 11:50:54.110045 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.109887 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 27 11:50:54.114819 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.114783 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm"] Jul 27 11:50:54.162101 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.162066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-tmp\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.162255 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.162112 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmf4z\" (UniqueName: \"kubernetes.io/projected/b14dd4c8-1b42-4878-995a-8bb3224a1229-kube-api-access-qmf4z\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.162255 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.162134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-manifests-work\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.262549 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.262513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-manifests-work\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.262711 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.262677 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-tmp\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.262755 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.262731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmf4z\" (UniqueName: \"kubernetes.io/projected/b14dd4c8-1b42-4878-995a-8bb3224a1229-kube-api-access-qmf4z\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.262981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.262966 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-manifests-work\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.262981 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.262974 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dd4c8-1b42-4878-995a-8bb3224a1229-tmp\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.271309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.271280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmf4z\" (UniqueName: \"kubernetes.io/projected/b14dd4c8-1b42-4878-995a-8bb3224a1229-kube-api-access-qmf4z\") pod \"trainer-operator-controller-manager-5794cb664f-qpcqm\" (UID: \"b14dd4c8-1b42-4878-995a-8bb3224a1229\") " pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.417491 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.417379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:54.543309 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.543147 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm"] Jul 27 11:50:54.546007 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:50:54.545978 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14dd4c8_1b42_4878_995a_8bb3224a1229.slice/crio-e27bbd24f6215bb6ff4d1f6d72a672921d268a55ad39f4258915f8204f0df960 WatchSource:0}: Error finding container e27bbd24f6215bb6ff4d1f6d72a672921d268a55ad39f4258915f8204f0df960: Status 404 returned error can't find the container with id e27bbd24f6215bb6ff4d1f6d72a672921d268a55ad39f4258915f8204f0df960 Jul 27 11:50:54.664011 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:54.663979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" event={"ID":"b14dd4c8-1b42-4878-995a-8bb3224a1229","Type":"ContainerStarted","Data":"e27bbd24f6215bb6ff4d1f6d72a672921d268a55ad39f4258915f8204f0df960"} Jul 27 11:50:57.679341 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:57.679308 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" event={"ID":"b14dd4c8-1b42-4878-995a-8bb3224a1229","Type":"ContainerStarted","Data":"9db65dcf6c9f98a2c9e8871c8876366fc58408a488c4e4e91c34774446a0977a"} Jul 27 11:50:57.679742 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:57.679535 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:50:57.698388 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:50:57.698336 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" podStartSLOduration=1.3915146059999999 podStartE2EDuration="3.698319574s" totalImagesPullingTime="2.306804968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:50:57.696515125 +0000 UTC m=+427.228866185" watchObservedRunningTime="2026-07-27 11:50:57.698319574 +0000 UTC m=+427.230670621" Jul 27 11:51:08.684551 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:08.684519 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-5794cb664f-qpcqm" Jul 27 11:51:22.823103 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.823023 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f77dcd8cb-z7jss"] Jul 27 11:51:22.825849 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.825830 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.828642 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.828622 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 11:51:22.829388 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.829372 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 11:51:22.829663 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.829643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 11:51:22.829755 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.829700 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 11:51:22.829755 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.829738 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcfv6\"" Jul 27 11:51:22.829877 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.829785 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 11:51:22.833406 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.833389 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 11:51:22.842340 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.842319 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f77dcd8cb-z7jss"] Jul 27 11:51:22.877402 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877402 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877405 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-oauth-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877469 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-oauth-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-service-ca\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877551 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-trusted-ca-bundle\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.877598 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.877594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4hk\" (UniqueName: \"kubernetes.io/projected/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-kube-api-access-vv4hk\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978501 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-oauth-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978691 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-oauth-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978691 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-service-ca\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978691 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-trusted-ca-bundle\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978691 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978644 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.978691 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4hk\" (UniqueName: \"kubernetes.io/projected/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-kube-api-access-vv4hk\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.979009 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.978723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.979389 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.979358 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.979389 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.979383 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-oauth-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.979536 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.979412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-service-ca\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.979536 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.979508 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-trusted-ca-bundle\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.981160 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.981139 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-oauth-config\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.981289 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.981272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-console-serving-cert\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:22.987469 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:22.987450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4hk\" (UniqueName: \"kubernetes.io/projected/efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5-kube-api-access-vv4hk\") pod \"console-6f77dcd8cb-z7jss\" (UID: \"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5\") " pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:23.136208 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:23.136171 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:23.261839 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:23.261807 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f77dcd8cb-z7jss"] Jul 27 11:51:23.265670 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:51:23.265642 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc0ebf8_3ee5_4a8e_9fee_7f91a5edd7e5.slice/crio-d6f2d3f9db7c57a52d8f8a8fd3bf336873773952fefac03b5d2f4864847ec428 WatchSource:0}: Error finding container d6f2d3f9db7c57a52d8f8a8fd3bf336873773952fefac03b5d2f4864847ec428: Status 404 returned error can't find the container with id d6f2d3f9db7c57a52d8f8a8fd3bf336873773952fefac03b5d2f4864847ec428 Jul 27 11:51:23.771441 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:23.771404 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f77dcd8cb-z7jss" event={"ID":"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5","Type":"ContainerStarted","Data":"6a3399399b58b20f45dd76131f82bd7fbc1ed3e84e9cb34453be465783c83aa6"} Jul 27 11:51:23.771634 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:23.771467 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f77dcd8cb-z7jss" event={"ID":"efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5","Type":"ContainerStarted","Data":"d6f2d3f9db7c57a52d8f8a8fd3bf336873773952fefac03b5d2f4864847ec428"} Jul 27 11:51:23.790001 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:23.789955 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f77dcd8cb-z7jss" podStartSLOduration=1.7899377109999999 podStartE2EDuration="1.789937711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:51:23.788447101 +0000 UTC m=+453.320798159" watchObservedRunningTime="2026-07-27 11:51:23.789937711 +0000 UTC m=+453.322288759" Jul 27 11:51:33.137333 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:33.137282 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:33.137974 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:33.137361 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:33.142966 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:33.142942 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:33.810695 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:33.810669 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f77dcd8cb-z7jss" Jul 27 11:51:43.839401 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.839369 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:51:43.842365 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.842344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:43.844937 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.844912 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 11:51:43.845058 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.845013 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 11:51:43.845946 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.845928 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-5g7zp\"" Jul 27 11:51:43.846059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.845963 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 11:51:43.846059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.845972 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 11:51:43.850772 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.850751 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:51:43.949569 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.949539 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:43.949742 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.949579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:43.949742 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:43.949644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdx54\" (UniqueName: \"kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.050816 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.050763 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.050966 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.050826 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.050966 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.050872 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdx54\" (UniqueName: \"kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.051571 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.051551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.053040 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.053017 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.059699 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.059677 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdx54\" (UniqueName: \"kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.151862 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.151818 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:44.278896 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.278863 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:51:44.282574 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:51:44.282549 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f19ba9e_5c21_47a5_b98e_082f5af6783e.slice/crio-5a7da67ccb905d454a46a80cd69f786d5a8f0a96ed67d5ab6973ee9466181f6c WatchSource:0}: Error finding container 5a7da67ccb905d454a46a80cd69f786d5a8f0a96ed67d5ab6973ee9466181f6c: Status 404 returned error can't find the container with id 5a7da67ccb905d454a46a80cd69f786d5a8f0a96ed67d5ab6973ee9466181f6c Jul 27 11:51:44.845472 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:44.845439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" event={"ID":"6f19ba9e-5c21-47a5-b98e-082f5af6783e","Type":"ContainerStarted","Data":"5a7da67ccb905d454a46a80cd69f786d5a8f0a96ed67d5ab6973ee9466181f6c"} Jul 27 11:51:47.858153 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:47.858121 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" event={"ID":"6f19ba9e-5c21-47a5-b98e-082f5af6783e","Type":"ContainerStarted","Data":"7e4d3c6d24350dcf767ae830a8a99822c67ee89763708414ca7d969a5d8d6aaa"} Jul 27 11:51:47.858532 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:47.858243 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:51:47.874878 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:51:47.874833 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" podStartSLOduration=2.352084193 podStartE2EDuration="4.874816073s" totalImagesPullingTime="2.52273188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:51:47.873973984 +0000 UTC m=+477.406325034" watchObservedRunningTime="2026-07-27 11:51:47.874816073 +0000 UTC m=+477.407167121" Jul 27 11:52:03.867498 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:03.867465 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:52:05.673530 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.673496 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-nks4c"] Jul 27 11:52:05.681437 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.681416 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:52:05.684156 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.684128 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-b5kl9\"" Jul 27 11:52:05.685210 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.685178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-nks4c"] Jul 27 11:52:05.737066 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.737035 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x2rf\" (UniqueName: \"kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf\") pod \"test-trainjob-workflow-node-0-0-nks4c\" (UID: \"e09cfe73-757b-4846-804f-42370c26b02a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:52:05.837846 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.837814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x2rf\" (UniqueName: \"kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf\") pod \"test-trainjob-workflow-node-0-0-nks4c\" (UID: \"e09cfe73-757b-4846-804f-42370c26b02a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:52:05.846417 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.846392 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x2rf\" (UniqueName: \"kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf\") pod \"test-trainjob-workflow-node-0-0-nks4c\" (UID: \"e09cfe73-757b-4846-804f-42370c26b02a\") " pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:52:05.992319 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:05.992233 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:52:06.118160 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:06.118045 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-nks4c"] Jul 27 11:52:06.120826 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:52:06.120785 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode09cfe73_757b_4846_804f_42370c26b02a.slice/crio-907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98 WatchSource:0}: Error finding container 907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98: Status 404 returned error can't find the container with id 907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98 Jul 27 11:52:06.935013 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:52:06.934912 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" event={"ID":"e09cfe73-757b-4846-804f-42370c26b02a","Type":"ContainerStarted","Data":"907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98"} Jul 27 11:53:10.227942 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:10.227891 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" event={"ID":"e09cfe73-757b-4846-804f-42370c26b02a","Type":"ContainerStarted","Data":"812e7779276239076e3424acd5285ea3817f50017b3306b7ec8383c26647218f"} Jul 27 11:53:10.246657 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:10.246589 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" podStartSLOduration=1.757758791 podStartE2EDuration="1m5.246570464s" totalImagesPullingTime="1m3.488811673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:53:10.245633314 +0000 UTC m=+559.777984364" watchObservedRunningTime="2026-07-27 11:53:10.246570464 +0000 UTC m=+559.778921512" Jul 27 11:53:13.241251 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:13.241206 2583 generic.go:356] "Generic (PLEG): container finished" podID="e09cfe73-757b-4846-804f-42370c26b02a" containerID="812e7779276239076e3424acd5285ea3817f50017b3306b7ec8383c26647218f" exitCode=0 Jul 27 11:53:13.241609 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:13.241281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" event={"ID":"e09cfe73-757b-4846-804f-42370c26b02a","Type":"ContainerDied","Data":"812e7779276239076e3424acd5285ea3817f50017b3306b7ec8383c26647218f"} Jul 27 11:53:14.410039 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:14.410008 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:53:14.569030 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:14.568948 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x2rf\" (UniqueName: \"kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf\") pod \"e09cfe73-757b-4846-804f-42370c26b02a\" (UID: \"e09cfe73-757b-4846-804f-42370c26b02a\") " Jul 27 11:53:14.571132 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:14.571108 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf" (OuterVolumeSpecName: "kube-api-access-4x2rf") pod "e09cfe73-757b-4846-804f-42370c26b02a" (UID: "e09cfe73-757b-4846-804f-42370c26b02a"). InnerVolumeSpecName "kube-api-access-4x2rf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:53:14.669747 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:14.669708 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x2rf\" (UniqueName: \"kubernetes.io/projected/e09cfe73-757b-4846-804f-42370c26b02a-kube-api-access-4x2rf\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:53:15.250259 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:15.250186 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" Jul 27 11:53:15.250259 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:15.250212 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-nks4c" event={"ID":"e09cfe73-757b-4846-804f-42370c26b02a","Type":"ContainerDied","Data":"907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98"} Jul 27 11:53:15.250259 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:15.250246 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="907110cf4a4e1fb601a1d8e2b8e14ecd294d6c0d2164d0de067f0c3aca4ead98" Jul 27 11:53:15.905235 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:15.905204 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-nks4c"] Jul 27 11:53:15.909916 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:15.909894 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-nks4c"] Jul 27 11:53:16.032059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.032027 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:53:16.032254 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.032232 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" podUID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" containerName="manager" containerID="cri-o://7e4d3c6d24350dcf767ae830a8a99822c67ee89763708414ca7d969a5d8d6aaa" gracePeriod=30 Jul 27 11:53:16.256998 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.256962 2583 generic.go:356] "Generic (PLEG): container finished" podID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" containerID="7e4d3c6d24350dcf767ae830a8a99822c67ee89763708414ca7d969a5d8d6aaa" exitCode=0 Jul 27 11:53:16.257197 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.257015 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" event={"ID":"6f19ba9e-5c21-47a5-b98e-082f5af6783e","Type":"ContainerDied","Data":"7e4d3c6d24350dcf767ae830a8a99822c67ee89763708414ca7d969a5d8d6aaa"} Jul 27 11:53:16.318190 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.318159 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:53:16.384860 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.384823 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config\") pod \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " Jul 27 11:53:16.385059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.384891 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdx54\" (UniqueName: \"kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54\") pod \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " Jul 27 11:53:16.385059 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.384928 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert\") pod \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\" (UID: \"6f19ba9e-5c21-47a5-b98e-082f5af6783e\") " Jul 27 11:53:16.386912 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.386866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54" (OuterVolumeSpecName: "kube-api-access-sdx54") pod "6f19ba9e-5c21-47a5-b98e-082f5af6783e" (UID: "6f19ba9e-5c21-47a5-b98e-082f5af6783e"). InnerVolumeSpecName "kube-api-access-sdx54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:53:16.387043 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.386925 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert" (OuterVolumeSpecName: "cert") pod "6f19ba9e-5c21-47a5-b98e-082f5af6783e" (UID: "6f19ba9e-5c21-47a5-b98e-082f5af6783e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 11:53:16.388996 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.388972 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "6f19ba9e-5c21-47a5-b98e-082f5af6783e" (UID: "6f19ba9e-5c21-47a5-b98e-082f5af6783e"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 11:53:16.486535 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.486449 2583 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kubeflow-trainer-config\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:53:16.486535 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.486481 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdx54\" (UniqueName: \"kubernetes.io/projected/6f19ba9e-5c21-47a5-b98e-082f5af6783e-kube-api-access-sdx54\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:53:16.486535 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.486491 2583 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f19ba9e-5c21-47a5-b98e-082f5af6783e-cert\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:53:16.639768 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.639734 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lxm9d/must-gather-l8tww"] Jul 27 11:53:16.640122 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640108 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09cfe73-757b-4846-804f-42370c26b02a" containerName="node" Jul 27 11:53:16.640169 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640124 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09cfe73-757b-4846-804f-42370c26b02a" containerName="node" Jul 27 11:53:16.640169 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640133 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" containerName="manager" Jul 27 11:53:16.640169 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640139 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" containerName="manager" Jul 27 11:53:16.640261 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640194 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09cfe73-757b-4846-804f-42370c26b02a" containerName="node" Jul 27 11:53:16.640261 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.640203 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" containerName="manager" Jul 27 11:53:16.655384 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.655356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.655550 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.655497 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lxm9d/must-gather-l8tww"] Jul 27 11:53:16.657986 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.657952 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lxm9d\"/\"kube-root-ca.crt\"" Jul 27 11:53:16.658973 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.658949 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lxm9d\"/\"openshift-service-ca.crt\"" Jul 27 11:53:16.659103 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.658991 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lxm9d\"/\"default-dockercfg-rkkbq\"" Jul 27 11:53:16.789947 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.789855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.789947 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.789917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbhs\" (UniqueName: \"kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.890859 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.890834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbhs\" (UniqueName: \"kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.890996 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.890889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.891192 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.891177 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.899426 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.899400 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbhs\" (UniqueName: \"kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs\") pod \"must-gather-l8tww\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:16.954240 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.954208 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09cfe73-757b-4846-804f-42370c26b02a" path="/var/lib/kubelet/pods/e09cfe73-757b-4846-804f-42370c26b02a/volumes" Jul 27 11:53:16.964945 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:16.964928 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:53:17.128643 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.128612 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lxm9d/must-gather-l8tww"] Jul 27 11:53:17.132321 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:53:17.132294 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42dd69ef_7cf5_4b97_86c0_675612cffdc3.slice/crio-34988f6e1d270a5abf9038a194d9e5856662f9f2123387669ae5d394939b4733 WatchSource:0}: Error finding container 34988f6e1d270a5abf9038a194d9e5856662f9f2123387669ae5d394939b4733: Status 404 returned error can't find the container with id 34988f6e1d270a5abf9038a194d9e5856662f9f2123387669ae5d394939b4733 Jul 27 11:53:17.262083 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.262045 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxm9d/must-gather-l8tww" event={"ID":"42dd69ef-7cf5-4b97-86c0-675612cffdc3","Type":"ContainerStarted","Data":"34988f6e1d270a5abf9038a194d9e5856662f9f2123387669ae5d394939b4733"} Jul 27 11:53:17.263270 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.263247 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" event={"ID":"6f19ba9e-5c21-47a5-b98e-082f5af6783e","Type":"ContainerDied","Data":"5a7da67ccb905d454a46a80cd69f786d5a8f0a96ed67d5ab6973ee9466181f6c"} Jul 27 11:53:17.263382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.263272 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq" Jul 27 11:53:17.263382 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.263291 2583 scope.go:117] "RemoveContainer" containerID="7e4d3c6d24350dcf767ae830a8a99822c67ee89763708414ca7d969a5d8d6aaa" Jul 27 11:53:17.279634 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.279607 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:53:17.283778 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:17.283756 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-9nkkq"] Jul 27 11:53:18.957369 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:18.957321 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f19ba9e-5c21-47a5-b98e-082f5af6783e" path="/var/lib/kubelet/pods/6f19ba9e-5c21-47a5-b98e-082f5af6783e/volumes" Jul 27 11:53:25.303719 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:25.303618 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxm9d/must-gather-l8tww" event={"ID":"42dd69ef-7cf5-4b97-86c0-675612cffdc3","Type":"ContainerStarted","Data":"b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529"} Jul 27 11:53:25.303719 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:25.303672 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxm9d/must-gather-l8tww" event={"ID":"42dd69ef-7cf5-4b97-86c0-675612cffdc3","Type":"ContainerStarted","Data":"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f"} Jul 27 11:53:25.322485 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:53:25.322424 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lxm9d/must-gather-l8tww" podStartSLOduration=1.889979029 podStartE2EDuration="9.322403663s" totalImagesPullingTime="7.432424634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:53:25.320642638 +0000 UTC m=+574.852993714" watchObservedRunningTime="2026-07-27 11:53:25.322403663 +0000 UTC m=+574.854754713" Jul 27 11:54:11.503293 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:11.503209 2583 generic.go:356] "Generic (PLEG): container finished" podID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerID="0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f" exitCode=0 Jul 27 11:54:11.503674 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:11.503283 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxm9d/must-gather-l8tww" event={"ID":"42dd69ef-7cf5-4b97-86c0-675612cffdc3","Type":"ContainerDied","Data":"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f"} Jul 27 11:54:11.503674 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:11.503611 2583 scope.go:117] "RemoveContainer" containerID="0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f" Jul 27 11:54:12.258880 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.258842 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxm9d_must-gather-l8tww_42dd69ef-7cf5-4b97-86c0-675612cffdc3/gather/0.log" Jul 27 11:54:12.760614 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.760583 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sq8d/must-gather-8ff2g"] Jul 27 11:54:12.763272 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.763255 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:12.765746 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.765729 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2sq8d\"/\"default-dockercfg-5wbvz\"" Jul 27 11:54:12.765872 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.765732 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sq8d\"/\"kube-root-ca.crt\"" Jul 27 11:54:12.766818 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.766788 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sq8d\"/\"openshift-service-ca.crt\"" Jul 27 11:54:12.772514 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.772495 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sq8d/must-gather-8ff2g"] Jul 27 11:54:12.893680 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.893647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlgw\" (UniqueName: \"kubernetes.io/projected/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-kube-api-access-ptlgw\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:12.893877 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.893764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-must-gather-output\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:12.995204 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.995165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlgw\" (UniqueName: \"kubernetes.io/projected/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-kube-api-access-ptlgw\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:12.995385 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.995247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-must-gather-output\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:12.995579 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:12.995558 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-must-gather-output\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:13.002821 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:13.002778 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlgw\" (UniqueName: \"kubernetes.io/projected/0a28e0ab-270e-4fa6-a010-406b1cc7cb56-kube-api-access-ptlgw\") pod \"must-gather-8ff2g\" (UID: \"0a28e0ab-270e-4fa6-a010-406b1cc7cb56\") " pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:13.072634 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:13.072541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" Jul 27 11:54:13.199756 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:13.199712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sq8d/must-gather-8ff2g"] Jul 27 11:54:13.202611 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:54:13.202582 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a28e0ab_270e_4fa6_a010_406b1cc7cb56.slice/crio-43cef8a2e4db3191114b222bba8ba26cfb54339613941f7163fbd995551eecac WatchSource:0}: Error finding container 43cef8a2e4db3191114b222bba8ba26cfb54339613941f7163fbd995551eecac: Status 404 returned error can't find the container with id 43cef8a2e4db3191114b222bba8ba26cfb54339613941f7163fbd995551eecac Jul 27 11:54:13.511896 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:13.511859 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" event={"ID":"0a28e0ab-270e-4fa6-a010-406b1cc7cb56","Type":"ContainerStarted","Data":"43cef8a2e4db3191114b222bba8ba26cfb54339613941f7163fbd995551eecac"} Jul 27 11:54:14.520536 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:14.520012 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" event={"ID":"0a28e0ab-270e-4fa6-a010-406b1cc7cb56","Type":"ContainerStarted","Data":"17d6cf3b5b541516e0683c4bee83b98f008a1f3c6108c9825b465e853dcd6c4f"} Jul 27 11:54:14.520536 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:14.520072 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" event={"ID":"0a28e0ab-270e-4fa6-a010-406b1cc7cb56","Type":"ContainerStarted","Data":"b9016f0d3ef85c6eaa675e1c203b34a1417f04b75e3341ef7a34f4765c908b38"} Jul 27 11:54:14.537326 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:14.537261 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2sq8d/must-gather-8ff2g" podStartSLOduration=1.8181866960000002 podStartE2EDuration="2.537239057s" totalImagesPullingTime="719.052361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 11:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:54:14.536419313 +0000 UTC m=+624.068770361" watchObservedRunningTime="2026-07-27 11:54:14.537239057 +0000 UTC m=+624.069590106" Jul 27 11:54:15.331618 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:15.331580 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w4zct_f4baa8c7-13b7-418b-a600-134ae04cec0a/global-pull-secret-syncer/0.log" Jul 27 11:54:15.438051 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:15.438017 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pcrbk_4d854adc-4f2c-4730-af21-40e1c9d864cb/konnectivity-agent/0.log" Jul 27 11:54:15.518666 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:15.518634 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-65.ec2.internal_08e32bf3d80b75a9d91996cec2e03082/haproxy/0.log" Jul 27 11:54:17.605858 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:17.605107 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-lxm9d/must-gather-l8tww"] Jul 27 11:54:17.605858 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:17.605327 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-lxm9d/must-gather-l8tww" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="copy" containerID="cri-o://b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529" gracePeriod=2 Jul 27 11:54:17.610998 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:17.610759 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-lxm9d/must-gather-l8tww"] Jul 27 11:54:18.012817 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.012237 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxm9d_must-gather-l8tww_42dd69ef-7cf5-4b97-86c0-675612cffdc3/copy/0.log" Jul 27 11:54:18.017821 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.016231 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:54:18.025817 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:54:18.025202 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-l8tww\" is forbidden: User \"system:node:ip-10-0-138-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxm9d\": no relationship found between node 'ip-10-0-138-65.ec2.internal' and this object" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:54:18.152486 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.152405 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output\") pod \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " Jul 27 11:54:18.152486 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.152474 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmbhs\" (UniqueName: \"kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs\") pod \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\" (UID: \"42dd69ef-7cf5-4b97-86c0-675612cffdc3\") " Jul 27 11:54:18.154145 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.154105 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "42dd69ef-7cf5-4b97-86c0-675612cffdc3" (UID: "42dd69ef-7cf5-4b97-86c0-675612cffdc3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 11:54:18.155444 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.155409 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs" (OuterVolumeSpecName: "kube-api-access-hmbhs") pod "42dd69ef-7cf5-4b97-86c0-675612cffdc3" (UID: "42dd69ef-7cf5-4b97-86c0-675612cffdc3"). InnerVolumeSpecName "kube-api-access-hmbhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 11:54:18.254159 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.254114 2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42dd69ef-7cf5-4b97-86c0-675612cffdc3-must-gather-output\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:54:18.254159 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.254158 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmbhs\" (UniqueName: \"kubernetes.io/projected/42dd69ef-7cf5-4b97-86c0-675612cffdc3-kube-api-access-hmbhs\") on node \"ip-10-0-138-65.ec2.internal\" DevicePath \"\"" Jul 27 11:54:18.545768 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.545730 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxm9d_must-gather-l8tww_42dd69ef-7cf5-4b97-86c0-675612cffdc3/copy/0.log" Jul 27 11:54:18.546245 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.546213 2583 generic.go:356] "Generic (PLEG): container finished" podID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerID="b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529" exitCode=143 Jul 27 11:54:18.546367 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.546294 2583 scope.go:117] "RemoveContainer" containerID="b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529" Jul 27 11:54:18.546430 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.546301 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:54:18.549572 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:54:18.549535 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-l8tww\" is forbidden: User \"system:node:ip-10-0-138-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxm9d\": no relationship found between node 'ip-10-0-138-65.ec2.internal' and this object" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:54:18.559579 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.559549 2583 scope.go:117] "RemoveContainer" containerID="0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f" Jul 27 11:54:18.567205 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:54:18.567171 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-l8tww\" is forbidden: User \"system:node:ip-10-0-138-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxm9d\": no relationship found between node 'ip-10-0-138-65.ec2.internal' and this object" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" pod="openshift-must-gather-lxm9d/must-gather-l8tww" Jul 27 11:54:18.579369 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.579342 2583 scope.go:117] "RemoveContainer" containerID="b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529" Jul 27 11:54:18.580244 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:54:18.579948 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529\": container with ID starting with b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529 not found: ID does not exist" containerID="b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529" Jul 27 11:54:18.580244 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.579986 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529"} err="failed to get container status \"b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529\": rpc error: code = NotFound desc = could not find container \"b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529\": container with ID starting with b3ecc3bc08f12859c8dbb7705eacb22ce1bc594edc5e794ea077ade156b12529 not found: ID does not exist" Jul 27 11:54:18.580244 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.580012 2583 scope.go:117] "RemoveContainer" containerID="0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f" Jul 27 11:54:18.580644 ip-10-0-138-65 kubenswrapper[2583]: E0727 11:54:18.580546 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f\": container with ID starting with 0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f not found: ID does not exist" containerID="0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f" Jul 27 11:54:18.580644 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.580577 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f"} err="failed to get container status \"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f\": rpc error: code = NotFound desc = could not find container \"0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f\": container with ID starting with 0328b45f2e1799c727d711b72b893104e21c0b37381a7444ebc20fc5898ffa9f not found: ID does not exist" Jul 27 11:54:18.958901 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:18.958854 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" path="/var/lib/kubelet/pods/42dd69ef-7cf5-4b97-86c0-675612cffdc3/volumes" Jul 27 11:54:19.523869 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.523835 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w964z_ee5e004d-b810-4444-aa39-3651b9235857/kube-state-metrics/0.log" Jul 27 11:54:19.554184 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.554153 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w964z_ee5e004d-b810-4444-aa39-3651b9235857/kube-rbac-proxy-main/0.log" Jul 27 11:54:19.583138 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.583108 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-w964z_ee5e004d-b810-4444-aa39-3651b9235857/kube-rbac-proxy-self/0.log" Jul 27 11:54:19.614951 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.614920 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-867577d5b-wt8lm_8a7bca19-e8a2-4497-ba56-b1ca951484d3/metrics-server/0.log" Jul 27 11:54:19.643035 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.643006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-cb552_4c342b42-3fbb-416a-9da5-931f4e33e540/monitoring-plugin/0.log" Jul 27 11:54:19.682899 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.682872 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xxp7_71a1fdfb-5096-4f13-b320-ad8b1d076f08/node-exporter/0.log" Jul 27 11:54:19.709226 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.709197 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xxp7_71a1fdfb-5096-4f13-b320-ad8b1d076f08/kube-rbac-proxy/0.log" Jul 27 11:54:19.731737 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:19.731698 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xxp7_71a1fdfb-5096-4f13-b320-ad8b1d076f08/init-textfile/0.log" Jul 27 11:54:20.004816 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.004766 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/prometheus/0.log" Jul 27 11:54:20.026878 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.026853 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/config-reloader/0.log" Jul 27 11:54:20.053539 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.053511 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/thanos-sidecar/0.log" Jul 27 11:54:20.073567 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.073536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/kube-rbac-proxy-web/0.log" Jul 27 11:54:20.097085 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.097025 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/kube-rbac-proxy/0.log" Jul 27 11:54:20.121003 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.120964 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/kube-rbac-proxy-thanos/0.log" Jul 27 11:54:20.147984 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.147957 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8c66cfd0-19e4-4ef4-bbf1-0db0435b424c/init-config-reloader/0.log" Jul 27 11:54:20.178372 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.178339 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-htffw_c1dd0145-d662-4941-b36d-bbde4f34e2df/prometheus-operator/0.log" Jul 27 11:54:20.199181 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:20.199149 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-htffw_c1dd0145-d662-4941-b36d-bbde4f34e2df/kube-rbac-proxy/0.log" Jul 27 11:54:22.613732 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:22.613697 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f77dcd8cb-z7jss_efc0ebf8-3ee5-4a8e-9fee-7f91a5edd7e5/console/0.log" Jul 27 11:54:22.640228 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:22.640198 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-z6kjs_e04ea2c4-17b8-4df2-8fa2-07227aea9b41/download-server/0.log" Jul 27 11:54:23.137917 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.137886 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh"] Jul 27 11:54:23.138199 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138187 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="gather" Jul 27 11:54:23.138252 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138201 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="gather" Jul 27 11:54:23.138252 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138208 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="copy" Jul 27 11:54:23.138252 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138214 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="copy" Jul 27 11:54:23.138353 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138272 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="copy" Jul 27 11:54:23.138353 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.138283 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="42dd69ef-7cf5-4b97-86c0-675612cffdc3" containerName="gather" Jul 27 11:54:23.144210 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.144184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.150645 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.150611 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh"] Jul 27 11:54:23.215596 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.215560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-sys\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.215910 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.215892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-lib-modules\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.216098 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.216080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hktn2\" (UniqueName: \"kubernetes.io/projected/63f01c60-8847-4dac-89c5-e040a183154c-kube-api-access-hktn2\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.216346 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.216329 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-podres\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.216487 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.216472 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-proc\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317278 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317239 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-sys\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317443 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-lib-modules\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317443 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hktn2\" (UniqueName: \"kubernetes.io/projected/63f01c60-8847-4dac-89c5-e040a183154c-kube-api-access-hktn2\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317443 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-sys\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317443 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-podres\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317443 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-proc\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317673 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317516 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-lib-modules\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317673 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317521 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-proc\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.317673 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.317556 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63f01c60-8847-4dac-89c5-e040a183154c-podres\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.327226 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.327191 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hktn2\" (UniqueName: \"kubernetes.io/projected/63f01c60-8847-4dac-89c5-e040a183154c-kube-api-access-hktn2\") pod \"perf-node-gather-daemonset-k64lh\" (UID: \"63f01c60-8847-4dac-89c5-e040a183154c\") " pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.456844 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.456737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:23.626355 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:23.626276 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh"] Jul 27 11:54:23.637729 ip-10-0-138-65 kubenswrapper[2583]: W0727 11:54:23.637666 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63f01c60_8847_4dac_89c5_e040a183154c.slice/crio-0e2197faeced43644e889a6a334a8f63ac190e095bbeda92637ce4f12b433acd WatchSource:0}: Error finding container 0e2197faeced43644e889a6a334a8f63ac190e095bbeda92637ce4f12b433acd: Status 404 returned error can't find the container with id 0e2197faeced43644e889a6a334a8f63ac190e095bbeda92637ce4f12b433acd Jul 27 11:54:24.092075 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.092047 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vt7l_49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9/dns/0.log" Jul 27 11:54:24.119489 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.119461 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vt7l_49e1ee6a-dc9d-4fa3-87b9-5ed4b11084b9/kube-rbac-proxy/0.log" Jul 27 11:54:24.356463 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.356432 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wp5sl_d7d34400-f527-4fa2-ac46-d5e9ef31c762/dns-node-resolver/0.log" Jul 27 11:54:24.587293 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.587258 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" event={"ID":"63f01c60-8847-4dac-89c5-e040a183154c","Type":"ContainerStarted","Data":"2d4e12f0085bc4b316d6d86f929c5b5e0dc89d9408dc6eae267c8749d961312a"} Jul 27 11:54:24.587480 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.587322 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" event={"ID":"63f01c60-8847-4dac-89c5-e040a183154c","Type":"ContainerStarted","Data":"0e2197faeced43644e889a6a334a8f63ac190e095bbeda92637ce4f12b433acd"} Jul 27 11:54:24.587480 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.587436 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:24.894132 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:24.894104 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n45vf_eb13a4c2-0612-49b0-9922-5311b5593421/node-ca/0.log" Jul 27 11:54:26.142192 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:26.142164 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84xbl_36774873-2f15-49c9-ad8d-fa432c79ede5/serve-healthcheck-canary/0.log" Jul 27 11:54:26.825069 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:26.825040 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd8v9_6fae44be-49cd-4deb-82d2-090f52be9aa3/kube-rbac-proxy/0.log" Jul 27 11:54:26.849495 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:26.849472 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd8v9_6fae44be-49cd-4deb-82d2-090f52be9aa3/exporter/0.log" Jul 27 11:54:26.875904 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:26.875876 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gd8v9_6fae44be-49cd-4deb-82d2-090f52be9aa3/extractor/0.log" Jul 27 11:54:30.600266 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:30.600240 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" Jul 27 11:54:30.618441 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:30.618390 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2sq8d/perf-node-gather-daemonset-k64lh" podStartSLOduration=7.61836714 podStartE2EDuration="7.61836714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 11:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 11:54:24.611723254 +0000 UTC m=+634.144074298" watchObservedRunningTime="2026-07-27 11:54:30.61836714 +0000 UTC m=+640.150718214" Jul 27 11:54:34.066876 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.066849 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/kube-multus-additional-cni-plugins/0.log" Jul 27 11:54:34.117258 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.117229 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/egress-router-binary-copy/0.log" Jul 27 11:54:34.194037 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.194001 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/cni-plugins/0.log" Jul 27 11:54:34.268022 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.267992 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/bond-cni-plugin/0.log" Jul 27 11:54:34.306097 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.306066 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/routeoverride-cni/0.log" Jul 27 11:54:34.359302 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.359275 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/whereabouts-cni-bincopy/0.log" Jul 27 11:54:34.410341 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.410266 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xtcq9_d6054cf0-a845-4b74-b897-4ffe70a0ea83/whereabouts-cni/0.log" Jul 27 11:54:34.462465 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.462438 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fs8hj_6e9231d6-e22d-4239-a791-4d51ea96aa11/kube-multus/0.log" Jul 27 11:54:34.653709 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.653671 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tfwxs_10597122-4091-4d31-aebb-7c4d33b9dd6d/network-metrics-daemon/0.log" Jul 27 11:54:34.681008 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:34.680934 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tfwxs_10597122-4091-4d31-aebb-7c4d33b9dd6d/kube-rbac-proxy/0.log" Jul 27 11:54:35.667540 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.667512 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/ovn-controller/0.log" Jul 27 11:54:35.691584 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.691561 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/ovn-acl-logging/0.log" Jul 27 11:54:35.718707 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.718677 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/kube-rbac-proxy-node/0.log" Jul 27 11:54:35.742407 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.742380 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 11:54:35.769378 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.769349 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/northd/0.log" Jul 27 11:54:35.799862 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.799838 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/nbdb/0.log" Jul 27 11:54:35.823566 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.823538 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/sbdb/0.log" Jul 27 11:54:35.879451 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:35.879415 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6x2x_97377f06-2989-4954-a6f3-02dafeeb3531/ovnkube-controller/0.log" Jul 27 11:54:37.176302 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:37.176273 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-x5dcr_24088e29-a051-4fa2-bd46-d04ab5187a0c/network-check-target-container/0.log" Jul 27 11:54:38.084211 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:38.084174 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q74l5_6112f0dd-8f0c-4a80-83f3-609a633d493c/iptables-alerter/0.log" Jul 27 11:54:38.754142 ip-10-0-138-65 kubenswrapper[2583]: I0727 11:54:38.754109 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-trm9k_4c243ca6-3e14-4593-86d4-1962c4368772/tuned/0.log"