Jul 27 09:22:54.458338 ip-10-0-128-82 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 09:22:54.458346 ip-10-0-128-82 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 09:22:54.458353 ip-10-0-128-82 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 09:22:54.458601 ip-10-0-128-82 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 09:23:05.724277 ip-10-0-128-82 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 09:23:05.724299 ip-10-0-128-82 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6f662f9bd6be41d08cbf4268839773d2 -- Jul 27 09:24:38.966626 ip-10-0-128-82 systemd[1]: Starting Kubernetes Kubelet... Jul 27 09:24:39.416054 ip-10-0-128-82 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:24:39.416054 ip-10-0-128-82 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 09:24:39.416054 ip-10-0-128-82 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:24:39.416054 ip-10-0-128-82 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 09:24:39.416054 ip-10-0-128-82 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 09:24:39.417058 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.416973 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421180 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421212 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421216 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421220 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421223 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.421212 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421226 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421244 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421249 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421254 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421258 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421261 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421265 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421268 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421271 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421273 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421276 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421278 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421282 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421284 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421287 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421289 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421292 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421294 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421297 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421299 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.421413 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421302 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421305 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421307 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421310 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421312 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421315 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421317 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421319 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421322 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421324 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421327 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421329 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421332 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421335 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421339 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421342 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421345 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421347 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421350 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.421893 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421353 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421356 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421358 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421361 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421364 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421367 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421370 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421372 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421375 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421377 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421380 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421383 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421386 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421388 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421393 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421397 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421399 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421402 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421405 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421408 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.422380 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421412 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421414 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421417 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421423 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421427 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421430 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421433 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421437 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421440 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421443 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421446 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421448 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421451 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421453 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421456 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421458 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421461 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421464 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421466 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.422904 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421469 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421472 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421474 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421477 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421479 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421482 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421485 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421488 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421491 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421494 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421497 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421499 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421502 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421505 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421508 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.421511 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422250 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422258 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422263 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422267 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.423426 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422272 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422278 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422282 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422285 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422287 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422290 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422293 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422295 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422298 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422300 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422303 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422306 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422308 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422312 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422315 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422318 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422321 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422323 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422326 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.423929 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422328 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422331 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422334 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422336 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422339 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422342 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422345 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422347 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422350 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422353 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422355 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422358 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422360 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422364 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422367 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422370 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422375 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422378 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422381 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.424421 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422386 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422388 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422392 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422395 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422397 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422400 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422402 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422405 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422408 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422410 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422413 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422416 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422420 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422424 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422427 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422430 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422433 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422435 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422441 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422446 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.424887 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422448 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422451 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422454 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422456 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422459 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422462 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422465 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422468 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422470 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422474 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422476 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422479 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422482 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422485 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422487 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422490 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422492 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422495 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422497 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422500 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.425392 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422502 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422505 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422508 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422510 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422513 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422515 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422518 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422521 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422523 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422525 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422529 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422532 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422535 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422537 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422540 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422543 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422545 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422938 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422943 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422946 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.425966 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422949 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422952 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422955 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422958 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422961 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422963 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422966 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422968 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422971 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422973 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422976 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422979 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422981 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422984 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422987 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422989 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422992 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422995 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.422997 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423000 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.426484 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423003 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423005 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423009 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423011 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423014 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423017 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423019 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423021 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423024 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423026 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423029 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423032 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423035 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423037 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423040 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423043 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423045 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423047 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423050 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423053 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.427000 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423055 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423058 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423060 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423062 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423065 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423067 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423070 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423072 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423074 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423077 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423080 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423082 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423085 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423087 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423090 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423094 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423096 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423099 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423101 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423104 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.427524 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423106 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423108 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423112 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423114 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423117 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423122 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423125 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423129 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423132 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423135 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423138 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423141 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423145 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423149 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423152 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423154 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423157 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423159 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.428047 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423162 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423164 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423167 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423169 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423172 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423174 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423177 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423179 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423182 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423185 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423187 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423190 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423192 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423195 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423198 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423201 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423205 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423208 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423315 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423324 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423331 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 09:24:39.428508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423336 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423342 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423346 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423350 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423355 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423358 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423361 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423365 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423368 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423372 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423375 2566 flags.go:64] FLAG: --cgroup-root="" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423378 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423381 2566 flags.go:64] FLAG: --client-ca-file="" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423384 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423387 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423392 2566 flags.go:64] FLAG: --cluster-domain="" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423395 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423398 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423401 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423405 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423409 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423412 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423416 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 09:24:39.429017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423419 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423422 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423426 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423436 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423442 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423445 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423450 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423453 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423457 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423460 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423463 2566 flags.go:64] FLAG: --enable-server="true" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423467 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423472 2566 flags.go:64] FLAG: --event-burst="100" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423475 2566 flags.go:64] FLAG: --event-qps="50" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423478 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423481 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423484 2566 flags.go:64] FLAG: --eviction-hard="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423488 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423491 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423494 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423498 2566 flags.go:64] FLAG: --eviction-soft="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423501 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423504 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423507 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423510 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 09:24:39.429579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423513 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423517 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423520 2566 flags.go:64] FLAG: --feature-gates="" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423526 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423530 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423533 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423537 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423540 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423543 2566 flags.go:64] FLAG: --help="false" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423546 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423550 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423553 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423556 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423559 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423563 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423566 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423569 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423571 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423574 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423578 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423581 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423584 2566 flags.go:64] FLAG: --kube-reserved="" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423588 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423591 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 09:24:39.430253 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423594 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423597 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423600 2566 flags.go:64] FLAG: --lock-file="" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423603 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423606 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423609 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423615 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423618 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423621 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423623 2566 flags.go:64] FLAG: --logging-format="text" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423626 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423631 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423634 2566 flags.go:64] FLAG: --manifest-url="" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423637 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423642 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423645 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423649 2566 flags.go:64] FLAG: --max-pods="110" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423652 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423655 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423658 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423662 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423665 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423667 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423670 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423678 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 09:24:39.430853 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423682 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423685 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423688 2566 flags.go:64] FLAG: --pod-cidr="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423691 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423697 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423700 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423704 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423707 2566 flags.go:64] FLAG: --port="10250" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423712 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423715 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9bb8945d2817ec8" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423718 2566 flags.go:64] FLAG: --qos-reserved="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423721 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423724 2566 flags.go:64] FLAG: --register-node="true" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423727 2566 flags.go:64] FLAG: --register-with-taints="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423731 2566 flags.go:64] FLAG: --registry-burst="10" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423734 2566 flags.go:64] FLAG: --registry-qps="5" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423737 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423740 2566 flags.go:64] FLAG: --reserved-memory="" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423744 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423748 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423752 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423755 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423758 2566 flags.go:64] FLAG: --runonce="false" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423761 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423764 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 09:24:39.431534 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423767 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423770 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423773 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423777 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423780 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423783 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423786 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423789 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423792 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423795 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423798 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423801 2566 flags.go:64] FLAG: --system-cgroups="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423804 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423810 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423812 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423817 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423821 2566 flags.go:64] FLAG: --tls-min-version="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423824 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423827 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423830 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423833 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423836 2566 flags.go:64] FLAG: --v="2" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423840 2566 flags.go:64] FLAG: --version="false" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423844 2566 flags.go:64] FLAG: --vmodule="" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423848 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 09:24:39.432146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.423852 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423972 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423976 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423980 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423983 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423987 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423989 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423992 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423995 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.423997 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424000 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424003 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424005 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424008 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424011 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424015 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424019 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424022 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424024 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424030 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.432764 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424032 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424036 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424040 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424043 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424045 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424047 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424050 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424053 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424055 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424058 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424061 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424064 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424066 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424071 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424073 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424076 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424078 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424081 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424084 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.433522 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424087 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424089 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424092 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424095 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424097 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424100 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424103 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424105 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424108 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424110 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424113 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424116 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424119 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424122 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424124 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424128 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424131 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424133 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424136 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424138 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.434248 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424141 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424144 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424146 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424149 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424151 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424154 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424158 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424161 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424163 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424167 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424171 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424174 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424177 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424180 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424183 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424185 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424189 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424192 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424194 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.434777 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424197 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424200 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424202 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424205 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424208 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424210 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424213 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424216 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424220 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424224 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424227 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424247 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424251 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424255 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424258 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424260 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424263 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424266 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424268 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.435282 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424272 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424275 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.424277 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.424283 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.431802 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.431823 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.431845 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.431857 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431921 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431927 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431930 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431933 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431937 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431940 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.435759 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431942 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431945 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431948 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431950 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431953 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431956 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431958 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431961 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431964 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431966 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431969 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431972 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431974 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431977 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431979 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431982 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431985 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431987 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431991 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431995 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.436111 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.431998 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432002 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432005 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432017 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432020 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432023 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432026 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432029 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432032 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432035 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432038 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432041 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432044 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432046 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432049 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432052 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432054 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432057 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432059 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432062 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.436613 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432064 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432067 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432070 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432072 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432075 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432077 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432081 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432085 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432088 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432090 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432093 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432096 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432098 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432101 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432103 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432107 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432116 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432118 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432121 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.437110 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432125 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432128 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432131 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432134 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432138 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432141 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432143 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432146 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432149 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432151 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432155 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432157 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432160 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432163 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432166 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432168 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432171 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432174 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432176 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432179 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.437583 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432182 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432184 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432188 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432190 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432193 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432195 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432198 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432200 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432204 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432207 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432215 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432218 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432221 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432223 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.432241 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:24:39.438071 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432393 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432400 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432403 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432406 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432409 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432412 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432416 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432420 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432423 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432425 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432428 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432430 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432433 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432436 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432438 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432441 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432443 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432445 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432448 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 09:24:39.438464 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432451 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432453 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432456 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432458 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432461 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432464 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432467 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432469 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432472 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432480 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432483 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432486 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432488 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432491 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432494 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432496 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432499 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432501 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432504 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432506 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 09:24:39.438908 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432509 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432511 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432514 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432516 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432519 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432522 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432524 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432526 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432529 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432532 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432535 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432539 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432542 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432545 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432548 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432551 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432554 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432557 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432560 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432564 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 09:24:39.439419 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432566 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432569 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432585 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432588 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432590 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432593 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432596 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432598 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432601 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432605 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432608 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432611 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432614 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432617 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432620 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432622 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432625 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432628 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432630 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 09:24:39.439912 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432633 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432635 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432638 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432641 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432643 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432645 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432648 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432650 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432653 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432656 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432658 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432661 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432664 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432667 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432670 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432672 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432680 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432683 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432686 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432689 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 09:24:39.440398 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:39.432691 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.432696 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.433038 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.439328 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.440731 2566 server.go:1019] "Starting client certificate rotation" Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.440830 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:24:39.440907 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.440864 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 09:24:39.443447 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.443422 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:24:39.447628 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.447601 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 09:24:39.458566 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.458543 2566 log.go:25] "Validated CRI v1 runtime API" Jul 27 09:24:39.461292 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.461273 2566 log.go:25] "Validated CRI v1 image API" Jul 27 09:24:39.462975 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.462960 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 09:24:39.465674 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.465653 2566 fs.go:135] Filesystem UUIDs: map[4d8023e5-1141-4940-a809-e1c2431f12bf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 caa495da-c119-41cb-b163-c65f03bc8806:/dev/nvme0n1p3] Jul 27 09:24:39.465738 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.465675 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 09:24:39.472097 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.471968 2566 manager.go:216] Machine: {Timestamp:2026-07-27 09:24:39.470184498 +0000 UTC m=+0.379359085 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103390 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2465100313a0d0c94d6ebfc0d1dbdc SystemUUID:ec246510-0313-a0d0-c94d-6ebfc0d1dbdc BootID:6f662f9b-d6be-41d0-8cbf-4268839773d2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:52:d7:36:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:52:d7:36:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:a2:5a:5f:05:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 09:24:39.472097 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.472082 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 09:24:39.472255 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.472227 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 09:24:39.473801 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.473779 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:24:39.476023 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.475984 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 09:24:39.476217 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.476040 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 09:24:39.476897 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.476884 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 09:24:39.476950 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.476904 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 09:24:39.476950 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.476916 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:24:39.476950 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.476942 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 09:24:39.478578 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.478563 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 09:24:39.482124 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482106 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:24:39.482343 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482331 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 09:24:39.482419 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482374 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 27 09:24:39.482419 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482395 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 09:24:39.482517 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482427 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 09:24:39.482517 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482442 2566 kubelet.go:398] "Adding apiserver pod source" Jul 27 09:24:39.482517 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482465 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 09:24:39.482876 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482861 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:24:39.482936 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.482884 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 09:24:39.487187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.487163 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 09:24:39.489103 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.489083 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 09:24:39.489189 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.489124 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 09:24:39.490023 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490009 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490031 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490039 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490047 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490060 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490068 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490080 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 09:24:39.490090 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490087 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 09:24:39.490352 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490099 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 09:24:39.490352 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490108 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 09:24:39.490352 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490123 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 09:24:39.490352 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.490132 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 09:24:39.491654 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.491641 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 09:24:39.491718 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.491656 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 09:24:39.493338 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.493312 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 09:24:39.493338 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.493313 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 09:24:39.495085 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.495069 2566 server.go:1268] "Started kubelet" Jul 27 09:24:39.495188 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.495154 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 09:24:39.495281 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.495227 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 09:24:39.495330 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.495306 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 09:24:39.496032 ip-10-0-128-82 systemd[1]: Started Kubernetes Kubelet. Jul 27 09:24:39.497518 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.497500 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 09:24:39.498110 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.498091 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 27 09:24:39.501411 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.501381 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 09:24:39.501584 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.501566 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6z74" Jul 27 09:24:39.503643 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.503623 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 09:24:39.504758 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.503599 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c61b439c1f504b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-07-27 09:24:39.495037003 +0000 UTC m=+0.404211571,LastTimestamp:2026-07-27 09:24:39.495037003 +0000 UTC m=+0.404211571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}" Jul 27 09:24:39.506441 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.506421 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 09:24:39.506441 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.506434 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 09:24:39.506538 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.506513 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.507304 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507281 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 09:24:39.507387 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507325 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 09:24:39.507387 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507347 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 09:24:39.507624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507611 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 27 09:24:39.507624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507622 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 27 09:24:39.507985 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507968 2566 factory.go:153] Registering CRI-O factory Jul 27 09:24:39.508038 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.507991 2566 factory.go:223] Registration of the crio container factory successfully Jul 27 09:24:39.508085 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508047 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 09:24:39.508085 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508057 2566 factory.go:55] Registering systemd factory Jul 27 09:24:39.508085 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508066 2566 factory.go:223] Registration of the systemd container factory successfully Jul 27 09:24:39.508207 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508090 2566 factory.go:103] Registering Raw factory Jul 27 09:24:39.508207 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508104 2566 manager.go:1196] Started watching for new ooms in manager Jul 27 09:24:39.508568 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.508556 2566 manager.go:349] Starting recovery of all containers Jul 27 09:24:39.510485 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.510456 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 09:24:39.510655 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.510620 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 09:24:39.513501 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.513480 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6z74" Jul 27 09:24:39.519484 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.519456 2566 manager.go:354] Recovery completed Jul 27 09:24:39.525814 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.525793 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.527843 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.527823 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.527913 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.527864 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.527913 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.527879 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.528486 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.528468 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 09:24:39.528486 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.528481 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.528644 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.528481 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 09:24:39.528644 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.528523 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 27 09:24:39.529244 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529216 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.529311 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529257 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.529311 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529270 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.529934 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529919 2566 policy_none.go:49] "None policy: Start" Jul 27 09:24:39.529934 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529934 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 09:24:39.530057 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.529945 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 09:24:39.530687 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.530578 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c61b439e13f0d6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-07-27 09:24:39.527846102 +0000 UTC m=+0.437020681,LastTimestamp:2026-07-27 09:24:39.527846102 +0000 UTC m=+0.437020681,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}" Jul 27 09:24:39.531161 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.531145 2566 policy_none.go:47] "Start" Jul 27 09:24:39.566314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566052 2566 manager.go:337] "Starting Device Plugin manager" Jul 27 09:24:39.566314 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.566302 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 09:24:39.566314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566320 2566 server.go:87] "Starting device plugin registration server" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566612 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566629 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566745 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566881 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.566891 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.567465 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 09:24:39.577905 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.567515 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.609456 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.609413 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 09:24:39.610801 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.610784 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 09:24:39.610890 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.610863 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 09:24:39.610943 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.610911 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 09:24:39.610992 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.610971 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 09:24:39.614017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.613990 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:24:39.667745 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.667661 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.668648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.668630 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.668756 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.668661 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.668756 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.668680 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.668756 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.668711 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.677435 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.677410 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.677538 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.677441 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-82.ec2.internal\": node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.690443 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.690416 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.711778 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.711710 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"] Jul 27 09:24:39.711845 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.711833 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.712815 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.712795 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.712917 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.712830 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.712917 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.712846 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.714258 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.714224 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.714378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.714351 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.714412 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.714398 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.715574 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715557 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.715648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715589 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.715648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715601 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.715648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715557 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.715738 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715667 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.715738 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.715679 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.716912 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.716898 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.716964 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.716923 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 09:24:39.717683 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.717659 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory" Jul 27 09:24:39.717781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.717691 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 09:24:39.717781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.717701 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID" Jul 27 09:24:39.741226 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.741198 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.746063 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.746045 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.790799 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.790766 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.809086 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.809056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.809197 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.809114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2631d8e8e693fdb9ec27ceacdf6c4954-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"2631d8e8e693fdb9ec27ceacdf6c4954\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.809197 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.809137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.891455 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.891410 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:39.909585 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.909660 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.909660 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2631d8e8e693fdb9ec27ceacdf6c4954-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"2631d8e8e693fdb9ec27ceacdf6c4954\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.909660 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.909752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909670 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2631d8e8e693fdb9ec27ceacdf6c4954-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"2631d8e8e693fdb9ec27ceacdf6c4954\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.909752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:39.909649 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdefd77a2ce3aba9bb3bdbe5975c9952-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"bdefd77a2ce3aba9bb3bdbe5975c9952\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:39.992155 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:39.992068 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.043877 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.043851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:40.049281 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.049259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:40.092470 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.092435 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.195802 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.195740 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.297141 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.297039 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.400022 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.399977 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.441885 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.441841 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 09:24:40.442395 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.442011 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 09:24:40.500660 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.500625 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.520744 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.520693 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 09:19:40 +0000 UTC" deadline="2028-03-26 03:44:10.236968962 +0000 UTC" Jul 27 09:24:40.520744 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.520725 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14586h19m29.716246616s" Jul 27 09:24:40.599146 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:40.599101 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2631d8e8e693fdb9ec27ceacdf6c4954.slice/crio-657a87349a303bc4cec892cdd58e2909469c4e7eb6ba3faab454a2ef8102b731 WatchSource:0}: Error finding container 657a87349a303bc4cec892cdd58e2909469c4e7eb6ba3faab454a2ef8102b731: Status 404 returned error can't find the container with id 657a87349a303bc4cec892cdd58e2909469c4e7eb6ba3faab454a2ef8102b731 Jul 27 09:24:40.601385 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:40.601364 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found" Jul 27 09:24:40.602266 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.602240 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:24:40.607560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.607537 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" Jul 27 09:24:40.608970 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.608949 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:24:40.614533 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.614487 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"2631d8e8e693fdb9ec27ceacdf6c4954","Type":"ContainerStarted","Data":"657a87349a303bc4cec892cdd58e2909469c4e7eb6ba3faab454a2ef8102b731"} Jul 27 09:24:40.615446 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:40.615425 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdefd77a2ce3aba9bb3bdbe5975c9952.slice/crio-95a75d362747c253c9ef77b5c8dbcbc3751351ad754d03009cf22ee8494d8f3c WatchSource:0}: Error finding container 95a75d362747c253c9ef77b5c8dbcbc3751351ad754d03009cf22ee8494d8f3c: Status 404 returned error can't find the container with id 95a75d362747c253c9ef77b5c8dbcbc3751351ad754d03009cf22ee8494d8f3c Jul 27 09:24:40.622063 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.622043 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:24:40.623997 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.623979 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" Jul 27 09:24:40.637814 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.637779 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 09:24:40.668642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:40.668619 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:24:41.450267 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.450235 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:24:41.483814 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.483780 2566 apiserver.go:52] "Watching apiserver" Jul 27 09:24:41.495851 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.495814 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 09:24:41.496355 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.496321 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-cdr9w","openshift-image-registry/node-ca-wk5c4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal","openshift-multus/multus-additional-cni-plugins-mdhrz","openshift-multus/network-metrics-daemon-gr66c","openshift-network-diagnostics/network-check-target-6l4xq","kube-system/global-pull-secret-syncer-h5ssc","kube-system/konnectivity-agent-r5pmr","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq","openshift-cluster-node-tuning-operator/tuned-ckwkt","openshift-multus/multus-42mgd","openshift-network-operator/iptables-alerter-dvsjp","openshift-ovn-kubernetes/ovnkube-node-f76q6"] Jul 27 09:24:41.499233 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.499209 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.499384 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.499313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:41.499710 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.499686 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 09:24:41.501362 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.501337 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.504390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.503928 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.504390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.504141 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.504390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.504149 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.504622 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.504455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 09:24:41.504831 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.504807 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n5xtz\"" Jul 27 09:24:41.506430 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.506409 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.507057 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.507024 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 09:24:41.507334 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.507301 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 09:24:41.508132 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508109 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.508225 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508138 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 09:24:41.508438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508419 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 09:24:41.508518 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.508607 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508523 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zr2x6\"" Jul 27 09:24:41.508607 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508444 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 09:24:41.508801 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.508711 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.509072 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.509048 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.509180 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.509137 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:41.509828 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.509806 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 09:24:41.510126 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.510107 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 09:24:41.510210 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.510127 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.510274 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.510113 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h928n\"" Jul 27 09:24:41.510785 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.510550 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 09:24:41.511834 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.511813 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:41.511923 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.511883 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:41.514357 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.514333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.516963 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517456 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517556 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-dbus\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-ovn\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517655 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-node-log\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-bin\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-host-slash\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-kubelet\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.517805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-var-lib-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517836 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-iptables-alerter-script\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517934 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8s8dw\"" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.517948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-netd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518071 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-config\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-os-release\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovn-node-metrics-cert\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hpp\" (UniqueName: \"kubernetes.io/projected/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-kube-api-access-f4hpp\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tlvx\" (UniqueName: \"kubernetes.io/projected/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-kube-api-access-5tlvx\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-log-socket\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.519323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-env-overrides\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-kubelet-config\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-slash\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-systemd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvjr\" (UniqueName: \"kubernetes.io/projected/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-kube-api-access-grvjr\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518489 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-netns\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-etc-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ss6\" (UniqueName: \"kubernetes.io/projected/4a585125-e13d-4d16-8ad5-a2a60f3101c6-kube-api-access-k8ss6\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cnibin\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-systemd-units\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-script-lib\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.518868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-system-cni-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.520107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.519869 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.520676 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.520136 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c7qpr\"" Jul 27 09:24:41.520676 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.520441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.521653 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.521629 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.522176 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.522156 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 09:24:41.524151 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.524134 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.526818 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.526646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2699m\"" Jul 27 09:24:41.526929 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.526818 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.527563 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.526649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 09:24:41.527563 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.527494 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 09:24:41.528208 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.528190 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r9vdx\"" Jul 27 09:24:41.528540 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.528520 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.528680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.528458 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.530726 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.529003 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.530726 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.529009 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.532034 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.532012 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w52tm\"" Jul 27 09:24:41.532034 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.532025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:24:41.532346 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.532306 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.532480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.532462 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 09:24:41.535415 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.534993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rrvnr\"" Jul 27 09:24:41.535415 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.535016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 09:24:41.554396 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.554366 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwvq8" Jul 27 09:24:41.564708 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.564661 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwvq8" Jul 27 09:24:41.608639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.608606 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 09:24:41.617137 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.617087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"bdefd77a2ce3aba9bb3bdbe5975c9952","Type":"ContainerStarted","Data":"95a75d362747c253c9ef77b5c8dbcbc3751351ad754d03009cf22ee8494d8f3c"} Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-system-cni-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-socket-dir-parent\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-netns\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26lt\" (UniqueName: \"kubernetes.io/projected/d1f04aff-75ec-4223-909b-1479c6eced75-kube-api-access-k26lt\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-registration-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.619639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619635 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-system-cni-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-lib-modules\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-bin\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-host-slash\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619822 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-bin\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619895 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-host-slash\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-host\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.620087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.619989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5xl\" (UniqueName: \"kubernetes.io/projected/8b08e22c-d44f-4323-9595-41499b7827c4-kube-api-access-wg5xl\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-hosts-file\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-tmp-dir\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-iptables-alerter-script\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-netd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-config\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-conf-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovn-node-metrics-cert\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-device-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.620592 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-hostroot\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-socket-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-run\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-os-release\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-kubelet\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-env-overrides\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-modprobe-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-systemd\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-etc-tuned\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-etc-kubernetes\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.620984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkd5g\" (UniqueName: \"kubernetes.io/projected/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-kube-api-access-xkd5g\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621014 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cnibin\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-sys\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-var-lib-kubelet\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.621400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-tmp\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-script-lib\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-sys-fs\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621222 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-kubernetes\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-multus-certs\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621281 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621297 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-dbus\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-ovn\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqgp\" (UniqueName: \"kubernetes.io/projected/21936975-d33a-489f-910a-cfd8a9e967fd-kube-api-access-hlqgp\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee81109f-b933-49b5-8b94-784363f7986f-konnectivity-ca\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysconfig\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-conf\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-node-log\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.622272 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-kubelet\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-var-lib-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621717 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-system-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-os-release\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-cnibin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621886 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-iptables-alerter-script\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-multus\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-multus-daemon-config\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621946 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hpp\" (UniqueName: \"kubernetes.io/projected/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-kube-api-access-f4hpp\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.621994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-bin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tlvx\" (UniqueName: \"kubernetes.io/projected/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-kube-api-access-5tlvx\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-log-socket\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622069 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-host\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.623119 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-cni-binary-copy\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-k8s-cni-cncf-io\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-kubelet-config\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-slash\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-systemd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvjr\" (UniqueName: \"kubernetes.io/projected/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-kube-api-access-grvjr\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622399 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-node-log\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-netns\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622453 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-kubelet\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-etc-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ss6\" (UniqueName: \"kubernetes.io/projected/4a585125-e13d-4d16-8ad5-a2a60f3101c6-kube-api-access-k8ss6\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-etc-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622556 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-dbus\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-serviceca\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622600 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-cnibin\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.623841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62f9\" (UniqueName: \"kubernetes.io/projected/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-kube-api-access-s62f9\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee81109f-b933-49b5-8b94-784363f7986f-agent-certs\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-systemd-units\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622754 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-systemd-units\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622794 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-ovn\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622801 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-var-lib-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8709629b-6db6-42db-97d8-71b38defc42d-kubelet-config\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-openvswitch\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.622991 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.622996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-run-systemd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623059 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-cni-netd\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.623065 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:24:42.123041651 +0000 UTC m=+3.032216228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623086 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-config\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-slash\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.622991 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623275 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-host-run-netns\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623285 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a585125-e13d-4d16-8ad5-a2a60f3101c6-log-socket\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.624428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.625068 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.623338 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:24:42.12331629 +0000 UTC m=+3.032490861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:41.625068 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623368 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-os-release\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.625068 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623485 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovnkube-script-lib\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.625068 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.623525 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a585125-e13d-4d16-8ad5-a2a60f3101c6-env-overrides\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.626889 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.626861 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a585125-e13d-4d16-8ad5-a2a60f3101c6-ovn-node-metrics-cert\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.634149 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.634121 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvjr\" (UniqueName: \"kubernetes.io/projected/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-kube-api-access-grvjr\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:41.634331 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.634122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hpp\" (UniqueName: \"kubernetes.io/projected/cbc67ea7-d855-4be5-86ff-e0c3e32950f3-kube-api-access-f4hpp\") pod \"multus-additional-cni-plugins-mdhrz\" (UID: \"cbc67ea7-d855-4be5-86ff-e0c3e32950f3\") " pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.634536 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.634508 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tlvx\" (UniqueName: \"kubernetes.io/projected/f846b4ef-3a21-4098-a6b4-1ac7b433dbb6-kube-api-access-5tlvx\") pod \"iptables-alerter-dvsjp\" (UID: \"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6\") " pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.639227 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.639198 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ss6\" (UniqueName: \"kubernetes.io/projected/4a585125-e13d-4d16-8ad5-a2a60f3101c6-kube-api-access-k8ss6\") pod \"ovnkube-node-f76q6\" (UID: \"4a585125-e13d-4d16-8ad5-a2a60f3101c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.723438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-host\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.723438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723382 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5xl\" (UniqueName: \"kubernetes.io/projected/8b08e22c-d44f-4323-9595-41499b7827c4-kube-api-access-wg5xl\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.723438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-hosts-file\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.723438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-tmp-dir\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.723438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-conf-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-host\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-device-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723527 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-conf-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723539 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-hosts-file\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-hostroot\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-socket-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-device-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-run\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-os-release\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-kubelet\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-modprobe-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723733 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-run\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723743 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-os-release\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-systemd\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723746 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-socket-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.723800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723676 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-hostroot\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-etc-tuned\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723798 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-systemd\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723804 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-kubelet\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-etc-kubernetes\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkd5g\" (UniqueName: \"kubernetes.io/projected/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-kube-api-access-xkd5g\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723842 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-modprobe-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-sys\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-etc-kubernetes\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-var-lib-kubelet\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-tmp\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723972 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-var-lib-kubelet\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-sys\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.723974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724039 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-tmp-dir\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-sys-fs\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-kubernetes\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724149 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-sys-fs\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.725508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-multus-certs\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724212 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqgp\" (UniqueName: \"kubernetes.io/projected/21936975-d33a-489f-910a-cfd8a9e967fd-kube-api-access-hlqgp\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724214 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-kubernetes\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee81109f-b933-49b5-8b94-784363f7986f-konnectivity-ca\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724253 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-multus-certs\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724360 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysconfig\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-conf\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-system-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-cnibin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724484 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysconfig\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-multus\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-multus-daemon-config\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724528 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-system-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-cnibin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-bin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-host\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.726480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724587 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-multus\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724590 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-conf\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-cni-binary-copy\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724615 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-var-lib-cni-bin\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-k8s-cni-cncf-io\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724647 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-host\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-serviceca\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-k8s-cni-cncf-io\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62f9\" (UniqueName: \"kubernetes.io/projected/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-kube-api-access-s62f9\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee81109f-b933-49b5-8b94-784363f7986f-agent-certs\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-socket-dir-parent\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-netns\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26lt\" (UniqueName: \"kubernetes.io/projected/d1f04aff-75ec-4223-909b-1479c6eced75-kube-api-access-k26lt\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724822 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-registration-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724849 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-lib-modules\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724900 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee81109f-b933-49b5-8b94-784363f7986f-konnectivity-ca\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.724908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.727421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725010 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-cni-dir\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725158 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-multus-daemon-config\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725166 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f04aff-75ec-4223-909b-1479c6eced75-cni-binary-copy\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725177 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-multus-socket-dir-parent\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-serviceca\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725216 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f04aff-75ec-4223-909b-1479c6eced75-host-run-netns\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725220 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21936975-d33a-489f-910a-cfd8a9e967fd-registration-dir\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725285 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-etc-sysctl-d\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.725317 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b08e22c-d44f-4323-9595-41499b7827c4-lib-modules\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.726629 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-tmp\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.727528 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b08e22c-d44f-4323-9595-41499b7827c4-etc-tuned\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.728067 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.727776 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee81109f-b933-49b5-8b94-784363f7986f-agent-certs\") pod \"konnectivity-agent-r5pmr\" (UID: \"ee81109f-b933-49b5-8b94-784363f7986f\") " pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.747171 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.747134 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62f9\" (UniqueName: \"kubernetes.io/projected/275c6441-eb8c-43a6-8dcf-08c5e3570c2f-kube-api-access-s62f9\") pod \"node-ca-wk5c4\" (UID: \"275c6441-eb8c-43a6-8dcf-08c5e3570c2f\") " pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.747429 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.747141 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26lt\" (UniqueName: \"kubernetes.io/projected/d1f04aff-75ec-4223-909b-1479c6eced75-kube-api-access-k26lt\") pod \"multus-42mgd\" (UID: \"d1f04aff-75ec-4223-909b-1479c6eced75\") " pod="openshift-multus/multus-42mgd" Jul 27 09:24:41.747429 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.747402 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:41.747429 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.747427 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:41.747571 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.747440 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:41.747571 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:41.747530 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:24:42.247509747 +0000 UTC m=+3.156684322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:41.749112 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.749084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkd5g\" (UniqueName: \"kubernetes.io/projected/a1d1c894-f81e-40c8-a71d-a6608ea79fe9-kube-api-access-xkd5g\") pod \"node-resolver-cdr9w\" (UID: \"a1d1c894-f81e-40c8-a71d-a6608ea79fe9\") " pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.750282 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.750255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5xl\" (UniqueName: \"kubernetes.io/projected/8b08e22c-d44f-4323-9595-41499b7827c4-kube-api-access-wg5xl\") pod \"tuned-ckwkt\" (UID: \"8b08e22c-d44f-4323-9595-41499b7827c4\") " pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.750389 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.750294 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqgp\" (UniqueName: \"kubernetes.io/projected/21936975-d33a-489f-910a-cfd8a9e967fd-kube-api-access-hlqgp\") pod \"aws-ebs-csi-driver-node-mb4sq\" (UID: \"21936975-d33a-489f-910a-cfd8a9e967fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.816304 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.816255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dvsjp" Jul 27 09:24:41.829480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.829445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:24:41.841754 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.841715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" Jul 27 09:24:41.850027 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.849995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" Jul 27 09:24:41.858274 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.858229 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:24:41.866338 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.866311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cdr9w" Jul 27 09:24:41.874438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.874405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk5c4" Jul 27 09:24:41.882484 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.882457 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" Jul 27 09:24:41.888700 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:41.888665 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42mgd" Jul 27 09:24:42.128607 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:42.128521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:42.128607 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:42.128607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:42.128803 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.128695 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:42.128803 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.128721 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:42.128803 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.128767 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:24:43.128750061 +0000 UTC m=+4.037924617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:42.128803 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.128782 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:24:43.128776132 +0000 UTC m=+4.037950689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:42.330803 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:42.330759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:42.330981 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.330946 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:42.330981 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.330975 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:42.331095 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.330989 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:42.331095 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:42.331052 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:24:43.331037738 +0000 UTC m=+4.240212300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:42.568705 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:42.568603 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:19:42 +0000 UTC" deadline="2028-01-05 08:05:53.605698749 +0000 UTC" Jul 27 09:24:42.568705 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:42.568650 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12646h41m11.037054442s" Jul 27 09:24:42.768879 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.768842 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc67ea7_d855_4be5_86ff_e0c3e32950f3.slice/crio-05c666ce68f0dab2ec44bad2e7d8bf1dab6f4817dc89c162ddeebba8f41727ad WatchSource:0}: Error finding container 05c666ce68f0dab2ec44bad2e7d8bf1dab6f4817dc89c162ddeebba8f41727ad: Status 404 returned error can't find the container with id 05c666ce68f0dab2ec44bad2e7d8bf1dab6f4817dc89c162ddeebba8f41727ad Jul 27 09:24:42.769797 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.769770 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf846b4ef_3a21_4098_a6b4_1ac7b433dbb6.slice/crio-0ff9a91433325ac6d2fcf0f7a46f86ae401442c848db461dbaf49a9183ea4997 WatchSource:0}: Error finding container 0ff9a91433325ac6d2fcf0f7a46f86ae401442c848db461dbaf49a9183ea4997: Status 404 returned error can't find the container with id 0ff9a91433325ac6d2fcf0f7a46f86ae401442c848db461dbaf49a9183ea4997 Jul 27 09:24:42.770692 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.770585 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275c6441_eb8c_43a6_8dcf_08c5e3570c2f.slice/crio-2d58e34e0c2927ab0a28e44a9529a9d5d8e3b1d2b4d504ee1efef8390a0804a9 WatchSource:0}: Error finding container 2d58e34e0c2927ab0a28e44a9529a9d5d8e3b1d2b4d504ee1efef8390a0804a9: Status 404 returned error can't find the container with id 2d58e34e0c2927ab0a28e44a9529a9d5d8e3b1d2b4d504ee1efef8390a0804a9 Jul 27 09:24:42.774745 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.774532 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b08e22c_d44f_4323_9595_41499b7827c4.slice/crio-42b69206d44977252fe6c179c1b2e48c4eb1e3ec617c22825c9315f7be21e232 WatchSource:0}: Error finding container 42b69206d44977252fe6c179c1b2e48c4eb1e3ec617c22825c9315f7be21e232: Status 404 returned error can't find the container with id 42b69206d44977252fe6c179c1b2e48c4eb1e3ec617c22825c9315f7be21e232 Jul 27 09:24:42.775466 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.775439 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f04aff_75ec_4223_909b_1479c6eced75.slice/crio-efaaa8a7c72a6dbf52c6e213ac39c200a8267f3aa3da9860fe6eb735712a3fe9 WatchSource:0}: Error finding container efaaa8a7c72a6dbf52c6e213ac39c200a8267f3aa3da9860fe6eb735712a3fe9: Status 404 returned error can't find the container with id efaaa8a7c72a6dbf52c6e213ac39c200a8267f3aa3da9860fe6eb735712a3fe9 Jul 27 09:24:42.777239 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.777209 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d1c894_f81e_40c8_a71d_a6608ea79fe9.slice/crio-10813fac05f0ece54e97a847fffbbbe0e36f1ec160862644de465fbd2793a444 WatchSource:0}: Error finding container 10813fac05f0ece54e97a847fffbbbe0e36f1ec160862644de465fbd2793a444: Status 404 returned error can't find the container with id 10813fac05f0ece54e97a847fffbbbe0e36f1ec160862644de465fbd2793a444 Jul 27 09:24:42.778953 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.778796 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21936975_d33a_489f_910a_cfd8a9e967fd.slice/crio-e6162dd9287773d731cffe134fa82ba800d7010efb919cd03ae270c03b6be487 WatchSource:0}: Error finding container e6162dd9287773d731cffe134fa82ba800d7010efb919cd03ae270c03b6be487: Status 404 returned error can't find the container with id e6162dd9287773d731cffe134fa82ba800d7010efb919cd03ae270c03b6be487 Jul 27 09:24:42.781708 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.780313 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee81109f_b933_49b5_8b94_784363f7986f.slice/crio-20fa78cd75ed60f95cb6d2e67d9b8078c3d6a09428171e184b9eaef8c1eca798 WatchSource:0}: Error finding container 20fa78cd75ed60f95cb6d2e67d9b8078c3d6a09428171e184b9eaef8c1eca798: Status 404 returned error can't find the container with id 20fa78cd75ed60f95cb6d2e67d9b8078c3d6a09428171e184b9eaef8c1eca798 Jul 27 09:24:42.781708 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:24:42.781646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a585125_e13d_4d16_8ad5_a2a60f3101c6.slice/crio-1ae790e1d59a1c656da8d67cae515bfca107547f42d34a4d9eca2e42867a744f WatchSource:0}: Error finding container 1ae790e1d59a1c656da8d67cae515bfca107547f42d34a4d9eca2e42867a744f: Status 404 returned error can't find the container with id 1ae790e1d59a1c656da8d67cae515bfca107547f42d34a4d9eca2e42867a744f Jul 27 09:24:43.137560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.137436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:43.137560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.137511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:43.137739 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.137611 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:43.137739 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.137683 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:24:45.137666122 +0000 UTC m=+6.046840679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:43.137739 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.137620 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:43.137838 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.137777 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:24:45.137761467 +0000 UTC m=+6.046936038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:43.340844 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.339999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:43.340844 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.340183 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:43.340844 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.340205 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:43.340844 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.340219 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:43.340844 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.340309 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:24:45.340264543 +0000 UTC m=+6.249439125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:43.569624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.569549 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 09:19:42 +0000 UTC" deadline="2028-04-27 15:48:12.355800582 +0000 UTC" Jul 27 09:24:43.569624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.569620 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h23m28.786185021s" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.613444 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.613596 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.613730 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.613851 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.613950 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:43.616413 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:43.614039 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:43.636627 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.636515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5pmr" event={"ID":"ee81109f-b933-49b5-8b94-784363f7986f","Type":"ContainerStarted","Data":"20fa78cd75ed60f95cb6d2e67d9b8078c3d6a09428171e184b9eaef8c1eca798"} Jul 27 09:24:43.645677 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.645637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" event={"ID":"21936975-d33a-489f-910a-cfd8a9e967fd","Type":"ContainerStarted","Data":"e6162dd9287773d731cffe134fa82ba800d7010efb919cd03ae270c03b6be487"} Jul 27 09:24:43.655276 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.655236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" event={"ID":"8b08e22c-d44f-4323-9595-41499b7827c4","Type":"ContainerStarted","Data":"42b69206d44977252fe6c179c1b2e48c4eb1e3ec617c22825c9315f7be21e232"} Jul 27 09:24:43.659125 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.659029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk5c4" event={"ID":"275c6441-eb8c-43a6-8dcf-08c5e3570c2f","Type":"ContainerStarted","Data":"2d58e34e0c2927ab0a28e44a9529a9d5d8e3b1d2b4d504ee1efef8390a0804a9"} Jul 27 09:24:43.664282 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.664237 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"2631d8e8e693fdb9ec27ceacdf6c4954","Type":"ContainerStarted","Data":"288282427f27593b6b6e62f45287fac1a3de6387f89fff90be1aaba78cfc10be"} Jul 27 09:24:43.666705 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.666607 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cdr9w" event={"ID":"a1d1c894-f81e-40c8-a71d-a6608ea79fe9","Type":"ContainerStarted","Data":"10813fac05f0ece54e97a847fffbbbe0e36f1ec160862644de465fbd2793a444"} Jul 27 09:24:43.673017 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.672935 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42mgd" event={"ID":"d1f04aff-75ec-4223-909b-1479c6eced75","Type":"ContainerStarted","Data":"efaaa8a7c72a6dbf52c6e213ac39c200a8267f3aa3da9860fe6eb735712a3fe9"} Jul 27 09:24:43.674822 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.674709 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dvsjp" event={"ID":"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6","Type":"ContainerStarted","Data":"0ff9a91433325ac6d2fcf0f7a46f86ae401442c848db461dbaf49a9183ea4997"} Jul 27 09:24:43.690547 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.690498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerStarted","Data":"05c666ce68f0dab2ec44bad2e7d8bf1dab6f4817dc89c162ddeebba8f41727ad"} Jul 27 09:24:43.707273 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.706514 2566 generic.go:356] "Generic (PLEG): container finished" podID="bdefd77a2ce3aba9bb3bdbe5975c9952" containerID="ec182c46ab271e4a627372fa54ee5c1b46e907cb6077e0edb060b0e312a52319" exitCode=0 Jul 27 09:24:43.707273 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.706848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"bdefd77a2ce3aba9bb3bdbe5975c9952","Type":"ContainerDied","Data":"ec182c46ab271e4a627372fa54ee5c1b46e907cb6077e0edb060b0e312a52319"} Jul 27 09:24:43.722095 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.721970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"1ae790e1d59a1c656da8d67cae515bfca107547f42d34a4d9eca2e42867a744f"} Jul 27 09:24:43.725624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:43.725556 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" podStartSLOduration=2.725533147 podStartE2EDuration="2.725533147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:24:43.680714065 +0000 UTC m=+4.589888646" watchObservedRunningTime="2026-07-27 09:24:43.725533147 +0000 UTC m=+4.634707729" Jul 27 09:24:44.763540 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:44.763478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"bdefd77a2ce3aba9bb3bdbe5975c9952","Type":"ContainerStarted","Data":"fa7f4b7a7270be1d779489c7d2c591cf80ecb3ef4054f04caf915ebd331df566"} Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.155636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.155730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.155887 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.155989 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:24:49.155968184 +0000 UTC m=+10.065142770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.156452 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:45.156644 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.156513 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:24:49.156494729 +0000 UTC m=+10.065669302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:45.358896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.358131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:45.358896 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.358387 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:45.358896 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.358413 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:45.358896 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.358428 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:45.358896 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.358496 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:24:49.35847613 +0000 UTC m=+10.267650690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:45.613813 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.613716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:45.613981 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.613876 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:45.614343 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.614298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:45.614445 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.614423 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:45.614526 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:45.614482 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:45.614581 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:45.614558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:47.611993 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:47.611954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:47.611993 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:47.611990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:47.612665 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:47.612116 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:47.612665 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:47.612211 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:47.612665 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:47.612311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:47.612665 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:47.612400 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:49.194902 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.194130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:49.194902 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.194219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:49.194902 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.194368 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:49.194902 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.194440 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:24:57.194417492 +0000 UTC m=+18.103592067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:49.195522 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.194931 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:49.195522 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.194997 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:24:57.194977996 +0000 UTC m=+18.104152569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:49.395851 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.395799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:49.396036 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.396019 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:49.396102 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.396049 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:49.396102 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.396064 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:49.396227 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.396133 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:24:57.3961105 +0000 UTC m=+18.305285106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:49.613726 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.613686 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:49.613911 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.613696 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:49.613911 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.613848 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:49.613911 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:49.613872 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:49.614132 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.613965 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:49.614132 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:49.614047 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:51.613467 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:51.613388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:51.613973 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:51.613390 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:51.614159 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:51.614130 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:51.614300 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:51.614137 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:51.614300 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:51.614225 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:51.614404 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:51.614309 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:53.612169 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:53.612131 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:53.612648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:53.612141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:53.612648 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:53.612278 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:53.612648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:53.612141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:53.612648 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:53.612390 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:53.612648 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:53.612485 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:55.612319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:55.612274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:55.612736 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:55.612274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:55.612736 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:55.612409 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:55.612736 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:55.612275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:55.612736 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:55.612495 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:55.612736 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:55.612575 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:57.259137 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.259098 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:57.259597 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.259155 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:57.259597 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.259282 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:57.259597 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.259284 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:57.259597 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.259342 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:25:13.259327688 +0000 UTC m=+34.168502243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:24:57.259597 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.259356 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:25:13.259349735 +0000 UTC m=+34.168524289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:24:57.459750 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.459713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:57.459908 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.459891 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:24:57.459952 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.459916 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:24:57.459952 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.459926 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:57.460037 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.459988 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:25:13.459967741 +0000 UTC m=+34.369142320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:24:57.611632 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.611601 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:57.611827 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.611601 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:57.611827 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:57.611734 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:57.611827 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.611738 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:57.611936 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.611843 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:57.611936 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:57.611925 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:24:59.612083 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:59.612042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:24:59.612604 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:59.612182 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:24:59.612604 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:59.612269 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:24:59.612604 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:24:59.612333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:24:59.612604 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:59.612420 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:24:59.612604 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:24:59.612511 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:01.611417 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:01.611298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:01.611417 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:01.611355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:01.611417 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:01.611298 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:01.611983 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:01.611444 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:01.611983 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:01.611533 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:01.611983 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:01.611638 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:02.801551 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.801361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" event={"ID":"8b08e22c-d44f-4323-9595-41499b7827c4","Type":"ContainerStarted","Data":"6f9ab9b073c08e489aaa92a46ad8598109d804f3bd886e212ca35e3c60e73128"} Jul 27 09:25:02.802876 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.802846 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk5c4" event={"ID":"275c6441-eb8c-43a6-8dcf-08c5e3570c2f","Type":"ContainerStarted","Data":"de555cf1ae5a92b9f12d4e2870f81688186e2d9107ca316d27ec9cf9a6e8d4d9"} Jul 27 09:25:02.804191 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.804162 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cdr9w" event={"ID":"a1d1c894-f81e-40c8-a71d-a6608ea79fe9","Type":"ContainerStarted","Data":"85caf35a0d06b6188437528eba4e6c1ee86aeb32cd3e7dc682f047243d833a55"} Jul 27 09:25:02.805847 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.805817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42mgd" event={"ID":"d1f04aff-75ec-4223-909b-1479c6eced75","Type":"ContainerStarted","Data":"1bd821c90d4e33a44c3dc16d82e33dfbbf253a336089884aa6f03baff0fd5b0f"} Jul 27 09:25:02.807434 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.807408 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="b3790eb8db76293432ab7ab9b98b01004800d8774228b6fa9b7596412a8fe372" exitCode=0 Jul 27 09:25:02.807553 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.807495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"b3790eb8db76293432ab7ab9b98b01004800d8774228b6fa9b7596412a8fe372"} Jul 27 09:25:02.811084 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"aacacb6ce9cbefdd34cf8793c66a761c51b3b7f366bd3bea2a73f63b33085159"} Jul 27 09:25:02.811174 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"23ac3aa42bdec5329ed249872ae0897c510c877449def7a410a1f874598c4ad4"} Jul 27 09:25:02.811249 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"50f0e16180b3b31122f5646fe60f051f63f6a6012edae5699ff4dcd0ad71c5e0"} Jul 27 09:25:02.811249 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"a2ade20597f0f7fe18b7f1e4dc36ba3e177eaaab66f0580686459ed7d617d223"} Jul 27 09:25:02.811356 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"8acbcec2cd9333618b4a7e75ec37367f7659526e3cfdee985fbbedbde7518f97"} Jul 27 09:25:02.811356 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.811305 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"2b3b3e82ba9df831d45f90145b6be2bc832f42972ede7b1995351e57cb4f7a63"} Jul 27 09:25:02.812594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.812573 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5pmr" event={"ID":"ee81109f-b933-49b5-8b94-784363f7986f","Type":"ContainerStarted","Data":"b8986461c363b9839914eb4de60316d21e64246d755dee3977dd6600e8b086d8"} Jul 27 09:25:02.814504 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.814484 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" event={"ID":"21936975-d33a-489f-910a-cfd8a9e967fd","Type":"ContainerStarted","Data":"c6f2489f6bad2a81c42dc0b51d8ed124f7ab097b39beaf5492d6ae140fa6a22e"} Jul 27 09:25:02.820686 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.820648 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ckwkt" podStartSLOduration=3.499640036 podStartE2EDuration="22.820635465s" totalImagesPullingTime="19.320995429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:02.820300901 +0000 UTC m=+23.729475499" watchObservedRunningTime="2026-07-27 09:25:02.820635465 +0000 UTC m=+23.729810042" Jul 27 09:25:02.821028 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.820998 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" podStartSLOduration=21.820990244 podStartE2EDuration="21.820990244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:24:44.788475619 +0000 UTC m=+5.697650201" watchObservedRunningTime="2026-07-27 09:25:02.820990244 +0000 UTC m=+23.730164821" Jul 27 09:25:02.854488 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.854433 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r5pmr" podStartSLOduration=3.540257665 podStartE2EDuration="22.854415743s" totalImagesPullingTime="19.314158078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:02.854130528 +0000 UTC m=+23.763305105" watchObservedRunningTime="2026-07-27 09:25:02.854415743 +0000 UTC m=+23.763590314" Jul 27 09:25:02.870459 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.870411 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cdr9w" podStartSLOduration=3.530994117 podStartE2EDuration="22.870395699s" totalImagesPullingTime="19.339401582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:02.870088387 +0000 UTC m=+23.779262965" watchObservedRunningTime="2026-07-27 09:25:02.870395699 +0000 UTC m=+23.779570275" Jul 27 09:25:02.884614 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.884559 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wk5c4" podStartSLOduration=3.55696861 podStartE2EDuration="22.88454605s" totalImagesPullingTime="19.32757744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:02.884041704 +0000 UTC m=+23.793216280" watchObservedRunningTime="2026-07-27 09:25:02.88454605 +0000 UTC m=+23.793720627" Jul 27 09:25:02.900187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:02.900095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-42mgd" podStartSLOduration=3.532245472 podStartE2EDuration="22.900085876s" totalImagesPullingTime="19.367840404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:02.899793206 +0000 UTC m=+23.808967785" watchObservedRunningTime="2026-07-27 09:25:02.900085876 +0000 UTC m=+23.809260452" Jul 27 09:25:03.611505 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.611473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:03.611722 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.611473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:03.611722 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:03.611589 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:03.611722 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.611478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:03.611722 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:03.611649 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:03.611941 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:03.611732 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:03.648742 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.648652 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:25:03.649367 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.649350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:25:03.818357 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.818281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dvsjp" event={"ID":"f846b4ef-3a21-4098-a6b4-1ac7b433dbb6","Type":"ContainerStarted","Data":"33e10f219493b9a6786042b2c5e7eb057342c85e509e8a830a7892176d91b684"} Jul 27 09:25:03.819556 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.819524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:25:03.819671 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.819593 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r5pmr" Jul 27 09:25:03.836226 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.836166 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dvsjp" podStartSLOduration=4.511037683 podStartE2EDuration="23.836145183s" totalImagesPullingTime="19.3251075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:03.835709586 +0000 UTC m=+24.744884175" watchObservedRunningTime="2026-07-27 09:25:03.836145183 +0000 UTC m=+24.745319765" Jul 27 09:25:03.871346 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:03.871281 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 09:25:04.581190 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:04.581074 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T09:25:03.871304102Z","UUID":"f5188176-0345-4516-8d2b-840ddcf6d9e9","Handler":null,"Name":"","Endpoint":""} Jul 27 09:25:04.582766 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:04.582738 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 09:25:04.582915 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:04.582782 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 09:25:04.822718 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:04.822672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" event={"ID":"21936975-d33a-489f-910a-cfd8a9e967fd","Type":"ContainerStarted","Data":"c49aa57afcb6704bdfe1ac511e8d60ede6d739a14093da2c99a35683715ded6f"} Jul 27 09:25:05.611538 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.611318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:05.611900 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.611318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:05.611900 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:05.611598 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:05.611900 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:05.611651 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:05.611900 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.611318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:05.611900 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:05.611751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:05.827719 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.827676 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" event={"ID":"21936975-d33a-489f-910a-cfd8a9e967fd","Type":"ContainerStarted","Data":"19403d980fa779cfd96a923df535d54918b2142e554b85a93fe4987039f0e718"} Jul 27 09:25:05.831499 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.831472 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"da70c2cf7937317013d7f9da1833eb788f00d4006242fe2f33043c57552fe8c0"} Jul 27 09:25:05.845092 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:05.845034 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mb4sq" podStartSLOduration=3.9207265380000003 podStartE2EDuration="25.845018983s" totalImagesPullingTime="21.924292445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:05.844877086 +0000 UTC m=+26.754051690" watchObservedRunningTime="2026-07-27 09:25:05.845018983 +0000 UTC m=+26.754193561" Jul 27 09:25:07.611940 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.611779 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:07.612752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.611779 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:07.612752 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:07.612019 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:07.612752 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:07.612130 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:07.612752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.611780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:07.612752 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:07.612223 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:07.839412 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.839319 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" event={"ID":"4a585125-e13d-4d16-8ad5-a2a60f3101c6","Type":"ContainerStarted","Data":"b5abac9ef3b2597e2e38487a78a9acbc7e7945ac0555293cfcbc1a2cfc62d926"} Jul 27 09:25:07.839597 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.839579 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:07.841050 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.841024 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="887cf7f36a50ed94a510833531f62586b51cb9ddb11f649af133bb3111bd2eba" exitCode=0 Jul 27 09:25:07.841164 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.841056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"887cf7f36a50ed94a510833531f62586b51cb9ddb11f649af133bb3111bd2eba"} Jul 27 09:25:07.856624 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.856591 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:07.864814 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:07.864773 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" podStartSLOduration=8.464508422 podStartE2EDuration="27.864756716s" totalImagesPullingTime="19.400248294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:07.864504459 +0000 UTC m=+28.773679035" watchObservedRunningTime="2026-07-27 09:25:07.864756716 +0000 UTC m=+28.773931335" Jul 27 09:25:08.843085 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:08.843058 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 09:25:08.843629 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:08.843608 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:08.858989 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:08.858964 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:09.370322 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.370283 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h5ssc"] Jul 27 09:25:09.370504 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.370416 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:09.370558 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:09.370506 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:09.373418 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.373383 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6l4xq"] Jul 27 09:25:09.373542 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.373485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:09.373597 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:09.373558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:09.374250 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.374207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gr66c"] Jul 27 09:25:09.374353 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.374339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:09.374467 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:09.374445 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:09.847179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.847144 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="f3cb770f001b307149a3fa2428fe1302398f441db6ddf704657171e508bbb581" exitCode=0 Jul 27 09:25:09.847682 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.847241 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"f3cb770f001b307149a3fa2428fe1302398f441db6ddf704657171e508bbb581"} Jul 27 09:25:09.847682 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:09.847454 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 09:25:10.612148 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:10.611943 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:10.612341 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:10.611952 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:10.612341 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:10.611997 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:10.612341 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:10.612274 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:10.612341 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:10.612317 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:10.612495 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:10.612398 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:10.849661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:10.849631 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 09:25:11.374945 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:11.374916 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:11.854380 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:11.854247 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="51fe1ecbaf3e4f06430b356de07e298b5e1e195f3cf745222b92983c7d5c1897" exitCode=0 Jul 27 09:25:11.854380 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:11.854337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"51fe1ecbaf3e4f06430b356de07e298b5e1e195f3cf745222b92983c7d5c1897"} Jul 27 09:25:12.611786 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:12.611751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:12.611976 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:12.611801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:12.611976 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:12.611854 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:12.611976 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:12.611870 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:12.612082 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:12.611966 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:12.612082 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:12.612057 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:13.279408 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:13.279374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:13.279845 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:13.279433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:13.279845 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.279543 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:25:13.279845 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.279554 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 09:25:13.279845 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.279618 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret podName:8709629b-6db6-42db-97d8-71b38defc42d nodeName:}" failed. No retries permitted until 2026-07-27 09:25:45.27959963 +0000 UTC m=+66.188774197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret") pod "global-pull-secret-syncer-h5ssc" (UID: "8709629b-6db6-42db-97d8-71b38defc42d") : object "kube-system"/"original-pull-secret" not registered Jul 27 09:25:13.279845 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.279639 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:25:45.279629192 +0000 UTC m=+66.188803747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 09:25:13.481921 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:13.481834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:13.482086 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.481954 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 09:25:13.482086 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.481972 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 09:25:13.482086 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.481982 2566 projected.go:196] Error preparing data for projected volume kube-api-access-gtj9q for pod openshift-network-diagnostics/network-check-target-6l4xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:25:13.482086 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:13.482051 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q podName:f26121d2-bc69-4813-bf89-fb8a12a719bf nodeName:}" failed. No retries permitted until 2026-07-27 09:25:45.482029357 +0000 UTC m=+66.391203931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtj9q" (UniqueName: "kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q") pod "network-check-target-6l4xq" (UID: "f26121d2-bc69-4813-bf89-fb8a12a719bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 09:25:14.611944 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.611889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:14.612571 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:14.612022 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h5ssc" podUID="8709629b-6db6-42db-97d8-71b38defc42d" Jul 27 09:25:14.612571 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.611889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:14.612571 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:14.612141 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:25:14.612571 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.611890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:14.612571 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:14.612216 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6l4xq" podUID="f26121d2-bc69-4813-bf89-fb8a12a719bf" Jul 27 09:25:14.890986 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.890914 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeReady" Jul 27 09:25:14.891142 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.891031 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 09:25:14.950828 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.950786 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r7r26"] Jul 27 09:25:14.953593 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.953559 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:14.954363 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.954332 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k6qjn"] Jul 27 09:25:14.956216 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.956195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:14.956216 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.956208 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 09:25:14.956404 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.956254 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 09:25:14.956404 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.956254 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v4cq5\"" Jul 27 09:25:14.959372 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.959350 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 09:25:14.959586 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.959569 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 09:25:14.959647 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.959586 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 09:25:14.959703 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.959649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zzcwm\"" Jul 27 09:25:14.964989 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.964967 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r7r26"] Jul 27 09:25:14.969710 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:14.969649 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6qjn"] Jul 27 09:25:15.091785 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.091747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4485aa85-ab5f-4e59-9bb3-0adcd783362c-cert\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.092041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.091832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738f5986-5028-4703-b421-e09472c0e04f-tmp-dir\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.092041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.091883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vss4r\" (UniqueName: \"kubernetes.io/projected/738f5986-5028-4703-b421-e09472c0e04f-kube-api-access-vss4r\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.092041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.091910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/738f5986-5028-4703-b421-e09472c0e04f-config-volume\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.092041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.091981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5m69\" (UniqueName: \"kubernetes.io/projected/4485aa85-ab5f-4e59-9bb3-0adcd783362c-kube-api-access-l5m69\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.092273 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.092039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193493 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738f5986-5028-4703-b421-e09472c0e04f-tmp-dir\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193493 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vss4r\" (UniqueName: \"kubernetes.io/projected/738f5986-5028-4703-b421-e09472c0e04f-kube-api-access-vss4r\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193712 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/738f5986-5028-4703-b421-e09472c0e04f-config-volume\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193712 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5m69\" (UniqueName: \"kubernetes.io/projected/4485aa85-ab5f-4e59-9bb3-0adcd783362c-kube-api-access-l5m69\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.193712 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193843 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4485aa85-ab5f-4e59-9bb3-0adcd783362c-cert\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.193843 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.193808 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/738f5986-5028-4703-b421-e09472c0e04f-tmp-dir\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.193843 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:15.193824 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:15.193973 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:15.193899 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:15.693876998 +0000 UTC m=+36.603051576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:15.194862 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.194840 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/738f5986-5028-4703-b421-e09472c0e04f-config-volume\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.198465 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.198441 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4485aa85-ab5f-4e59-9bb3-0adcd783362c-cert\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.202643 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.202610 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vss4r\" (UniqueName: \"kubernetes.io/projected/738f5986-5028-4703-b421-e09472c0e04f-kube-api-access-vss4r\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.203072 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.203027 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5m69\" (UniqueName: \"kubernetes.io/projected/4485aa85-ab5f-4e59-9bb3-0adcd783362c-kube-api-access-l5m69\") pod \"ingress-canary-k6qjn\" (UID: \"4485aa85-ab5f-4e59-9bb3-0adcd783362c\") " pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.274048 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.274009 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6qjn" Jul 27 09:25:15.697619 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:15.697574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:15.698034 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:15.697713 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:15.698034 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:15.697810 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:16.697792044 +0000 UTC m=+37.606966605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:16.057873 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.057622 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6qjn"] Jul 27 09:25:16.063422 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:25:16.063389 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4485aa85_ab5f_4e59_9bb3_0adcd783362c.slice/crio-8002c5cb381b6ea6ed5aeccdfc27951e187b1b1e8ae68ec0b3cf3bb1ebc9aa4a WatchSource:0}: Error finding container 8002c5cb381b6ea6ed5aeccdfc27951e187b1b1e8ae68ec0b3cf3bb1ebc9aa4a: Status 404 returned error can't find the container with id 8002c5cb381b6ea6ed5aeccdfc27951e187b1b1e8ae68ec0b3cf3bb1ebc9aa4a Jul 27 09:25:16.611757 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.611712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:16.611942 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.611712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:16.611942 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.611720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:16.615444 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615420 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:25:16.615444 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615420 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fpm4f\"" Jul 27 09:25:16.615745 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:25:16.615745 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615738 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:25:16.615868 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615753 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:25:16.615868 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.615743 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnzn6\"" Jul 27 09:25:16.706382 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.706342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:16.706837 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:16.706545 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:16.706837 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:16.706639 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:18.706616026 +0000 UTC m=+39.615790596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:16.869711 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.869621 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6qjn" event={"ID":"4485aa85-ab5f-4e59-9bb3-0adcd783362c","Type":"ContainerStarted","Data":"8002c5cb381b6ea6ed5aeccdfc27951e187b1b1e8ae68ec0b3cf3bb1ebc9aa4a"} Jul 27 09:25:16.872660 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.872632 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="96b0a826d202d62b1c4c7c238d87ce9c129f3d67926763ce5a7c95317d9e6895" exitCode=0 Jul 27 09:25:16.872798 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:16.872679 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"96b0a826d202d62b1c4c7c238d87ce9c129f3d67926763ce5a7c95317d9e6895"} Jul 27 09:25:17.879283 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:17.879249 2566 generic.go:356] "Generic (PLEG): container finished" podID="cbc67ea7-d855-4be5-86ff-e0c3e32950f3" containerID="2294cbb6b18a2eb7f6a8bc82f3a1e07dd43f87555e0b23bb34e30d18ceb9c6ee" exitCode=0 Jul 27 09:25:17.879729 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:17.879331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerDied","Data":"2294cbb6b18a2eb7f6a8bc82f3a1e07dd43f87555e0b23bb34e30d18ceb9c6ee"} Jul 27 09:25:18.722255 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:18.722059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:18.722255 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:18.722225 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:18.722491 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:18.722310 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:22.72229425 +0000 UTC m=+43.631468804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:18.883271 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:18.883225 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6qjn" event={"ID":"4485aa85-ab5f-4e59-9bb3-0adcd783362c","Type":"ContainerStarted","Data":"49c6014bbcaef61e9cce2e2de553d53c23cd3041284b470409946f21ee8558f3"} Jul 27 09:25:18.886669 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:18.886640 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" event={"ID":"cbc67ea7-d855-4be5-86ff-e0c3e32950f3","Type":"ContainerStarted","Data":"d6322fbed1378bc9f2a0bcf1b75b981cdb4a64892800967f6848cd7c4693d951"} Jul 27 09:25:18.902186 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:18.902135 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k6qjn" podStartSLOduration=2.5246672610000003 podStartE2EDuration="4.902120628s" totalImagesPullingTime="2.377453367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:18.901598952 +0000 UTC m=+39.810773528" watchObservedRunningTime="2026-07-27 09:25:18.902120628 +0000 UTC m=+39.811295204" Jul 27 09:25:18.923880 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:18.923824 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdhrz" podStartSLOduration=8.70747116 podStartE2EDuration="38.923808758s" totalImagesPullingTime="30.216337598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:18.922773331 +0000 UTC m=+39.831947929" watchObservedRunningTime="2026-07-27 09:25:18.923808758 +0000 UTC m=+39.832983332" Jul 27 09:25:22.751287 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:22.751218 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:22.751791 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:22.751387 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:22.751791 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:22.751458 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:30.751442621 +0000 UTC m=+51.660617176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:30.811294 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:30.811246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:30.811788 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:30.811394 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:30.811788 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:30.811474 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:25:46.811456276 +0000 UTC m=+67.720630831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:41.864354 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:41.864326 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f76q6" Jul 27 09:25:45.311462 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.311406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:45.311973 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.311503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:25:45.314283 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.314216 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 09:25:45.314390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.314303 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 09:25:45.322197 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:45.322167 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:25:45.322359 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:45.322345 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:26:49.322320761 +0000 UTC m=+130.231495328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : secret "metrics-daemon-secret" not found Jul 27 09:25:45.325878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.325855 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8709629b-6db6-42db-97d8-71b38defc42d-original-pull-secret\") pod \"global-pull-secret-syncer-h5ssc\" (UID: \"8709629b-6db6-42db-97d8-71b38defc42d\") " pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:45.427433 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.427378 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h5ssc" Jul 27 09:25:45.512662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.512631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:45.515722 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.515699 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 09:25:45.526758 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.526732 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 09:25:45.537286 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.537256 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtj9q\" (UniqueName: \"kubernetes.io/projected/f26121d2-bc69-4813-bf89-fb8a12a719bf-kube-api-access-gtj9q\") pod \"network-check-target-6l4xq\" (UID: \"f26121d2-bc69-4813-bf89-fb8a12a719bf\") " pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:45.553671 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.553637 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h5ssc"] Jul 27 09:25:45.556814 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:25:45.556783 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8709629b_6db6_42db_97d8_71b38defc42d.slice/crio-2e8739f366a1d332bfe7cf73ebe12cb36535ccab430bf88bf597eea97218d115 WatchSource:0}: Error finding container 2e8739f366a1d332bfe7cf73ebe12cb36535ccab430bf88bf597eea97218d115: Status 404 returned error can't find the container with id 2e8739f366a1d332bfe7cf73ebe12cb36535ccab430bf88bf597eea97218d115 Jul 27 09:25:45.735831 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.735797 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnzn6\"" Jul 27 09:25:45.744088 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.744063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:45.865333 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.865301 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6l4xq"] Jul 27 09:25:45.868451 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:25:45.868416 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26121d2_bc69_4813_bf89_fb8a12a719bf.slice/crio-3eab6ba440cdb35678f1223f5088cdd226ea1021d3ac2586b17d18774cd5e8a7 WatchSource:0}: Error finding container 3eab6ba440cdb35678f1223f5088cdd226ea1021d3ac2586b17d18774cd5e8a7: Status 404 returned error can't find the container with id 3eab6ba440cdb35678f1223f5088cdd226ea1021d3ac2586b17d18774cd5e8a7 Jul 27 09:25:45.954633 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.954589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6l4xq" event={"ID":"f26121d2-bc69-4813-bf89-fb8a12a719bf","Type":"ContainerStarted","Data":"3eab6ba440cdb35678f1223f5088cdd226ea1021d3ac2586b17d18774cd5e8a7"} Jul 27 09:25:45.955651 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:45.955629 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h5ssc" event={"ID":"8709629b-6db6-42db-97d8-71b38defc42d","Type":"ContainerStarted","Data":"2e8739f366a1d332bfe7cf73ebe12cb36535ccab430bf88bf597eea97218d115"} Jul 27 09:25:46.821390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:46.821347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:25:46.821955 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:46.821510 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:25:46.821955 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:25:46.821581 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:26:18.821563566 +0000 UTC m=+99.730738120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:25:50.971663 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:50.971631 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6l4xq" event={"ID":"f26121d2-bc69-4813-bf89-fb8a12a719bf","Type":"ContainerStarted","Data":"c56b3fd9387330f27b4eec978e5679e1e31609c75893d644b58e8d365f2f63e0"} Jul 27 09:25:50.972132 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:50.971740 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:25:50.973137 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:50.973112 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h5ssc" event={"ID":"8709629b-6db6-42db-97d8-71b38defc42d","Type":"ContainerStarted","Data":"6b09e0db158c36086da1755068429e362b8568029bff28268eb7bf509bf1ce9d"} Jul 27 09:25:50.990579 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:25:50.990471 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6l4xq" podStartSLOduration=66.530955885 podStartE2EDuration="1m10.990451276s" totalImagesPullingTime="4.459495391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:50.990282997 +0000 UTC m=+71.899457579" watchObservedRunningTime="2026-07-27 09:25:50.990451276 +0000 UTC m=+71.899625854" Jul 27 09:26:18.831577 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:18.831455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:26:18.831577 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:18.831573 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 09:26:18.832068 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:18.831636 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls podName:738f5986-5028-4703-b421-e09472c0e04f nodeName:}" failed. No retries permitted until 2026-07-27 09:27:22.831622032 +0000 UTC m=+163.740796587 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls") pod "dns-default-r7r26" (UID: "738f5986-5028-4703-b421-e09472c0e04f") : secret "dns-default-metrics-tls" not found Jul 27 09:26:21.978497 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:21.978464 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6l4xq" Jul 27 09:26:21.996418 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:21.996362 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h5ssc" podStartSLOduration=97.221032608 podStartE2EDuration="1m41.996318371s" totalImagesPullingTime="4.775285763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:25:51.007411034 +0000 UTC m=+71.916585610" watchObservedRunningTime="2026-07-27 09:26:21.996318371 +0000 UTC m=+102.905492965" Jul 27 09:26:49.334615 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:49.334573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:26:49.335019 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:49.334695 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 09:26:49.335019 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:49.334757 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs podName:2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08 nodeName:}" failed. No retries permitted until 2026-07-27 09:28:51.334743057 +0000 UTC m=+252.243917611 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs") pod "network-metrics-daemon-gr66c" (UID: "2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08") : secret "metrics-daemon-secret" not found Jul 27 09:26:56.888765 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.888727 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l"] Jul 27 09:26:56.890677 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.890660 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" Jul 27 09:26:56.892658 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.892629 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jqscl"] Jul 27 09:26:56.893063 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.893046 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 27 09:26:56.893683 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.893665 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c22lx\"" Jul 27 09:26:56.893683 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.893674 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 27 09:26:56.894245 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.894217 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.896706 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.896681 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 09:26:56.896802 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.896786 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 09:26:56.897673 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.897394 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zqmkv\"" Jul 27 09:26:56.898356 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.898332 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 09:26:56.900558 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.900540 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 09:26:56.903643 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.903624 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 09:26:56.904439 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.904421 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l"] Jul 27 09:26:56.911194 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.911170 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jqscl"] Jul 27 09:26:56.988003 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.987973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d46ee64-9dd3-4c64-ad72-3b61256378eb-serving-cert\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/3d46ee64-9dd3-4c64-ad72-3b61256378eb-kube-api-access-zn8hb\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988085 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7v8j\" (UniqueName: \"kubernetes.io/projected/aac83a7e-a69c-49fb-bc20-c67c40f3f16a-kube-api-access-k7v8j\") pod \"volume-data-source-validator-549c6d54cf-cv67l\" (UID: \"aac83a7e-a69c-49fb-bc20-c67c40f3f16a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-service-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-snapshots\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.988179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.988146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-tmp\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:56.994216 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.994185 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bfff56479-vns8n"] Jul 27 09:26:56.996092 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.996077 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:56.998924 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.998902 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 09:26:56.999364 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.999349 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 09:26:56.999555 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:56.999542 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 09:26:57.000957 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.000936 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 09:26:57.000957 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.000939 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vqcgv\"" Jul 27 09:26:57.001608 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.001588 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 09:26:57.001718 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.001636 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 09:26:57.013400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.013368 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bfff56479-vns8n"] Jul 27 09:26:57.088775 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088731 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/3d46ee64-9dd3-4c64-ad72-3b61256378eb-kube-api-access-zn8hb\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.088775 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7v8j\" (UniqueName: \"kubernetes.io/projected/aac83a7e-a69c-49fb-bc20-c67c40f3f16a-kube-api-access-k7v8j\") pod \"volume-data-source-validator-549c6d54cf-cv67l\" (UID: \"aac83a7e-a69c-49fb-bc20-c67c40f3f16a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-service-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-snapshots\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-default-certificate\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-tmp\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.088966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-stats-auth\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.089350 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srjcj\" (UniqueName: \"kubernetes.io/projected/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-kube-api-access-srjcj\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.089350 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d46ee64-9dd3-4c64-ad72-3b61256378eb-serving-cert\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089350 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.089350 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.089536 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089485 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-tmp\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089584 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3d46ee64-9dd3-4c64-ad72-3b61256378eb-snapshots\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.089659 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.089641 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-service-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.090155 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.090135 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d46ee64-9dd3-4c64-ad72-3b61256378eb-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.091435 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.091412 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d46ee64-9dd3-4c64-ad72-3b61256378eb-serving-cert\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.098428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.098404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7v8j\" (UniqueName: \"kubernetes.io/projected/aac83a7e-a69c-49fb-bc20-c67c40f3f16a-kube-api-access-k7v8j\") pod \"volume-data-source-validator-549c6d54cf-cv67l\" (UID: \"aac83a7e-a69c-49fb-bc20-c67c40f3f16a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" Jul 27 09:26:57.098528 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.098436 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/3d46ee64-9dd3-4c64-ad72-3b61256378eb-kube-api-access-zn8hb\") pod \"insights-operator-5885fdb759-jqscl\" (UID: \"3d46ee64-9dd3-4c64-ad72-3b61256378eb\") " pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.190308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.190189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-stats-auth\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.190308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.190253 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srjcj\" (UniqueName: \"kubernetes.io/projected/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-kube-api-access-srjcj\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.190538 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.190344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.190538 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.190379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.190538 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.190409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-default-certificate\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.190538 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.190484 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:26:57.190538 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.190529 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:26:57.690509547 +0000 UTC m=+138.599684101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:26:57.190773 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.190633 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:26:57.690596512 +0000 UTC m=+138.599771071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : secret "router-metrics-certs-default" not found Jul 27 09:26:57.192706 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.192687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-stats-auth\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.192765 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.192737 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-default-certificate\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.199291 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.199271 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srjcj\" (UniqueName: \"kubernetes.io/projected/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-kube-api-access-srjcj\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.202977 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.202960 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" Jul 27 09:26:57.209331 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.209311 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jqscl" Jul 27 09:26:57.332131 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.332033 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l"] Jul 27 09:26:57.334621 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:26:57.334596 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac83a7e_a69c_49fb_bc20_c67c40f3f16a.slice/crio-4a6f6792032f5b705a2709c6a1c3ae5c8a0d679852ad26e77468ad5c295da392 WatchSource:0}: Error finding container 4a6f6792032f5b705a2709c6a1c3ae5c8a0d679852ad26e77468ad5c295da392: Status 404 returned error can't find the container with id 4a6f6792032f5b705a2709c6a1c3ae5c8a0d679852ad26e77468ad5c295da392 Jul 27 09:26:57.349201 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.349163 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jqscl"] Jul 27 09:26:57.355359 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:26:57.355325 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d46ee64_9dd3_4c64_ad72_3b61256378eb.slice/crio-35c852361e107fed04aea2501414a8339911f5f35dc182c4ffc92be0cee2ea36 WatchSource:0}: Error finding container 35c852361e107fed04aea2501414a8339911f5f35dc182c4ffc92be0cee2ea36: Status 404 returned error can't find the container with id 35c852361e107fed04aea2501414a8339911f5f35dc182c4ffc92be0cee2ea36 Jul 27 09:26:57.693920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.693881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.694132 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:57.693932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:57.694132 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.694059 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:26:57.694132 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.694084 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:26:58.694068488 +0000 UTC m=+139.603243045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:26:57.694132 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:57.694122 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:26:58.694106868 +0000 UTC m=+139.603281436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : secret "router-metrics-certs-default" not found Jul 27 09:26:58.131781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:58.131737 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" event={"ID":"aac83a7e-a69c-49fb-bc20-c67c40f3f16a","Type":"ContainerStarted","Data":"4a6f6792032f5b705a2709c6a1c3ae5c8a0d679852ad26e77468ad5c295da392"} Jul 27 09:26:58.132919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:58.132890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jqscl" event={"ID":"3d46ee64-9dd3-4c64-ad72-3b61256378eb","Type":"ContainerStarted","Data":"35c852361e107fed04aea2501414a8339911f5f35dc182c4ffc92be0cee2ea36"} Jul 27 09:26:58.702793 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:58.702683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:58.702793 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:58.702750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:26:58.703005 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:58.702836 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:26:58.703005 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:58.702866 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:00.70285039 +0000 UTC m=+141.612024948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:26:58.703005 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:26:58.702891 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:00.702879124 +0000 UTC m=+141.612053683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : secret "router-metrics-certs-default" not found Jul 27 09:26:59.136911 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:59.136876 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" event={"ID":"aac83a7e-a69c-49fb-bc20-c67c40f3f16a","Type":"ContainerStarted","Data":"54a665fd1f4ce4e89c15e874d38cd50202a8b4622d4506e933d2317971194f5a"} Jul 27 09:26:59.157576 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:26:59.157508 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cv67l" podStartSLOduration=2.047594336 podStartE2EDuration="3.157489016s" totalImagesPullingTime="1.10989468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:26:59.157138576 +0000 UTC m=+140.066313178" watchObservedRunningTime="2026-07-27 09:26:59.157489016 +0000 UTC m=+140.066663591" Jul 27 09:27:00.141024 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.140982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jqscl" event={"ID":"3d46ee64-9dd3-4c64-ad72-3b61256378eb","Type":"ContainerStarted","Data":"ec665c1b920975f8429ccb53ba897b6dfddad532102f82c37205b56d9b8b4455"} Jul 27 09:27:00.160324 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.160267 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-jqscl" podStartSLOduration=2.262148255 podStartE2EDuration="4.160250548s" totalImagesPullingTime="1.898102293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:00.159355694 +0000 UTC m=+141.068530289" watchObservedRunningTime="2026-07-27 09:27:00.160250548 +0000 UTC m=+141.069425102" Jul 27 09:27:00.643942 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.643911 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bgwqr"] Jul 27 09:27:00.645944 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.645914 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.648187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.648163 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 09:27:00.648457 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.648439 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ldlr\"" Jul 27 09:27:00.648873 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.648860 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 09:27:00.659685 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.659653 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgwqr"] Jul 27 09:27:00.717752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.717720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:00.717931 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.717758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec34077-063b-4ee7-9733-240e62fe92cb-data-volume\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.717931 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.717792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec34077-063b-4ee7-9733-240e62fe92cb-crio-socket\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.717931 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.717815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.717931 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.717883 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:27:00.718136 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.717883 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:00.718136 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.717969 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:04.717948947 +0000 UTC m=+145.627123503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : secret "router-metrics-certs-default" not found Jul 27 09:27:00.718136 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.718008 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:04.717998262 +0000 UTC m=+145.627172819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:27:00.718136 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.718077 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45q9\" (UniqueName: \"kubernetes.io/projected/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-api-access-c45q9\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.718313 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.718134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819427 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45q9\" (UniqueName: \"kubernetes.io/projected/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-api-access-c45q9\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819438 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.819509 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.819558 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:01.319543747 +0000 UTC m=+142.228718302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : configmap "kube-rbac-proxy" not found Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec34077-063b-4ee7-9733-240e62fe92cb-data-volume\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec34077-063b-4ee7-9733-240e62fe92cb-crio-socket\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819620 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819918 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.819709 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:00.819918 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819708 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ec34077-063b-4ee7-9733-240e62fe92cb-crio-socket\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.819918 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:00.819748 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:01.319737777 +0000 UTC m=+142.228912334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:00.820038 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.819946 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec34077-063b-4ee7-9733-240e62fe92cb-data-volume\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:00.829092 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:00.829063 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45q9\" (UniqueName: \"kubernetes.io/projected/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-api-access-c45q9\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:01.322611 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:01.322565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:01.322994 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:01.322642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:01.322994 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:01.322683 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:27:01.322994 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:01.322745 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:01.322994 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:01.322752 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:02.322735818 +0000 UTC m=+143.231910372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : configmap "kube-rbac-proxy" not found Jul 27 09:27:01.322994 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:01.322787 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:02.322775383 +0000 UTC m=+143.231949943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:02.196159 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.196118 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5"] Jul 27 09:27:02.198256 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.198228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" Jul 27 09:27:02.200374 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.200352 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x9w9n\"" Jul 27 09:27:02.206759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.206734 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5"] Jul 27 09:27:02.330095 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.330062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/9d964010-518d-44ac-9d1a-077f3113ba88-kube-api-access-q2j6q\") pod \"network-check-source-7d88cb55d8-q5gm5\" (UID: \"9d964010-518d-44ac-9d1a-077f3113ba88\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.330112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.330161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:02.330250 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:02.330279 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:02.330331 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:04.330309686 +0000 UTC m=+145.239484240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : configmap "kube-rbac-proxy" not found Jul 27 09:27:02.330661 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:02.330349 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:04.330340674 +0000 UTC m=+145.239515235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:02.424653 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.424623 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cdr9w_a1d1c894-f81e-40c8-a71d-a6608ea79fe9/dns-node-resolver/0.log" Jul 27 09:27:02.431138 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.431116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/9d964010-518d-44ac-9d1a-077f3113ba88-kube-api-access-q2j6q\") pod \"network-check-source-7d88cb55d8-q5gm5\" (UID: \"9d964010-518d-44ac-9d1a-077f3113ba88\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" Jul 27 09:27:02.439658 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.439633 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/9d964010-518d-44ac-9d1a-077f3113ba88-kube-api-access-q2j6q\") pod \"network-check-source-7d88cb55d8-q5gm5\" (UID: \"9d964010-518d-44ac-9d1a-077f3113ba88\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" Jul 27 09:27:02.507174 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.507080 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" Jul 27 09:27:02.633655 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.633627 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5"] Jul 27 09:27:02.637203 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:02.637155 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d964010_518d_44ac_9d1a_077f3113ba88.slice/crio-d796829b0bd5294fd778579dafa5066ef46436c4d9b73768cb11d23e35879fdf WatchSource:0}: Error finding container d796829b0bd5294fd778579dafa5066ef46436c4d9b73768cb11d23e35879fdf: Status 404 returned error can't find the container with id d796829b0bd5294fd778579dafa5066ef46436c4d9b73768cb11d23e35879fdf Jul 27 09:27:02.761607 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.761529 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg"] Jul 27 09:27:02.763757 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.763739 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" Jul 27 09:27:02.770286 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.770258 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 09:27:02.770483 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.770466 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-544gm\"" Jul 27 09:27:02.770700 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.770685 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 09:27:02.775128 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.775108 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg"] Jul 27 09:27:02.833423 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.833379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdpn\" (UniqueName: \"kubernetes.io/projected/d444e44e-a3d1-45a2-a657-95c3a54b1080-kube-api-access-swdpn\") pod \"migrator-6865c9967-2vzjg\" (UID: \"d444e44e-a3d1-45a2-a657-95c3a54b1080\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" Jul 27 09:27:02.934595 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.934551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swdpn\" (UniqueName: \"kubernetes.io/projected/d444e44e-a3d1-45a2-a657-95c3a54b1080-kube-api-access-swdpn\") pod \"migrator-6865c9967-2vzjg\" (UID: \"d444e44e-a3d1-45a2-a657-95c3a54b1080\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" Jul 27 09:27:02.942928 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:02.942884 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdpn\" (UniqueName: \"kubernetes.io/projected/d444e44e-a3d1-45a2-a657-95c3a54b1080-kube-api-access-swdpn\") pod \"migrator-6865c9967-2vzjg\" (UID: \"d444e44e-a3d1-45a2-a657-95c3a54b1080\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" Jul 27 09:27:03.072254 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.072151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" Jul 27 09:27:03.151777 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.151738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" event={"ID":"9d964010-518d-44ac-9d1a-077f3113ba88","Type":"ContainerStarted","Data":"0bf6f6b53286458b14c2ae9abffe12a08338cdd43203b59ac579734d89b33ac1"} Jul 27 09:27:03.151921 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.151798 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" event={"ID":"9d964010-518d-44ac-9d1a-077f3113ba88","Type":"ContainerStarted","Data":"d796829b0bd5294fd778579dafa5066ef46436c4d9b73768cb11d23e35879fdf"} Jul 27 09:27:03.167990 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.167940 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5gm5" podStartSLOduration=1.167922124 podStartE2EDuration="1.167922124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:03.166958503 +0000 UTC m=+144.076133099" watchObservedRunningTime="2026-07-27 09:27:03.167922124 +0000 UTC m=+144.077096700" Jul 27 09:27:03.194988 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.194953 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg"] Jul 27 09:27:03.197788 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:03.197760 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd444e44e_a3d1_45a2_a657_95c3a54b1080.slice/crio-1a2ae806204c10d7f85bd35e98e5364437671035e6c4933f9deec673149d0bec WatchSource:0}: Error finding container 1a2ae806204c10d7f85bd35e98e5364437671035e6c4933f9deec673149d0bec: Status 404 returned error can't find the container with id 1a2ae806204c10d7f85bd35e98e5364437671035e6c4933f9deec673149d0bec Jul 27 09:27:03.631543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:03.631517 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk5c4_275c6441-eb8c-43a6-8dcf-08c5e3570c2f/node-ca/0.log" Jul 27 09:27:04.025121 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.025038 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6qjn_4485aa85-ab5f-4e59-9bb3-0adcd783362c/serve-healthcheck-canary/0.log" Jul 27 09:27:04.157167 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.157090 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" event={"ID":"d444e44e-a3d1-45a2-a657-95c3a54b1080","Type":"ContainerStarted","Data":"1a2ae806204c10d7f85bd35e98e5364437671035e6c4933f9deec673149d0bec"} Jul 27 09:27:04.183735 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.183701 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nrplz"] Jul 27 09:27:04.185845 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.185828 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.188185 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.188160 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 09:27:04.188359 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.188320 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 09:27:04.188418 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.188405 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 09:27:04.189020 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.189000 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 09:27:04.189102 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.189074 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gnr67\"" Jul 27 09:27:04.195765 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.195181 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nrplz"] Jul 27 09:27:04.349725 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.349700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-cabundle\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.349861 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.349750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:04.349861 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.349805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz4vm\" (UniqueName: \"kubernetes.io/projected/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-kube-api-access-pz4vm\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.349861 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.349827 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:27:04.349861 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.349844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-key\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.350018 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.349884 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:08.349861797 +0000 UTC m=+149.259036361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : configmap "kube-rbac-proxy" not found Jul 27 09:27:04.350018 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.349997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:04.350121 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.350108 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:04.350165 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.350154 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:08.350141061 +0000 UTC m=+149.259315641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:04.451443 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.451398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-cabundle\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.451647 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.451461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz4vm\" (UniqueName: \"kubernetes.io/projected/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-kube-api-access-pz4vm\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.451647 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.451483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-key\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.452163 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.452139 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-cabundle\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.453841 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.453816 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-signing-key\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.459497 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.459466 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz4vm\" (UniqueName: \"kubernetes.io/projected/dd6813bb-8191-40c6-b6d8-8672a77a7a2a-kube-api-access-pz4vm\") pod \"service-ca-658d7b7c78-nrplz\" (UID: \"dd6813bb-8191-40c6-b6d8-8672a77a7a2a\") " pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.496591 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.496556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" Jul 27 09:27:04.618048 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.618011 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-nrplz"] Jul 27 09:27:04.621572 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:04.621542 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6813bb_8191_40c6_b6d8_8672a77a7a2a.slice/crio-8aed689efd45ee38ffc4bdec53b4f7a4af68d564332bf89accda9ffde37ade85 WatchSource:0}: Error finding container 8aed689efd45ee38ffc4bdec53b4f7a4af68d564332bf89accda9ffde37ade85: Status 404 returned error can't find the container with id 8aed689efd45ee38ffc4bdec53b4f7a4af68d564332bf89accda9ffde37ade85 Jul 27 09:27:04.753724 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.753681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:04.754107 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:04.753749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:04.754107 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.753847 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 09:27:04.754107 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.753901 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:12.753887531 +0000 UTC m=+153.663062089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:27:04.754107 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:04.753918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:12.753912292 +0000 UTC m=+153.663086846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : secret "router-metrics-certs-default" not found Jul 27 09:27:05.162207 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:05.162168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" event={"ID":"dd6813bb-8191-40c6-b6d8-8672a77a7a2a","Type":"ContainerStarted","Data":"8aed689efd45ee38ffc4bdec53b4f7a4af68d564332bf89accda9ffde37ade85"} Jul 27 09:27:05.163781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:05.163753 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" event={"ID":"d444e44e-a3d1-45a2-a657-95c3a54b1080","Type":"ContainerStarted","Data":"83b80c7d53315720056b1c358febf2ea42113111b5735e1b4ae4385eda272a5a"} Jul 27 09:27:05.163902 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:05.163805 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" event={"ID":"d444e44e-a3d1-45a2-a657-95c3a54b1080","Type":"ContainerStarted","Data":"ce6402153639506100ee55c361440011ececa9c4c927afb2d6b18fef98ef0412"} Jul 27 09:27:05.180671 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:05.180602 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-2vzjg" podStartSLOduration=2.163062921 podStartE2EDuration="3.180583033s" totalImagesPullingTime="1.017520112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:05.180524661 +0000 UTC m=+146.089699237" watchObservedRunningTime="2026-07-27 09:27:05.180583033 +0000 UTC m=+146.089757611" Jul 27 09:27:07.171245 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:07.171194 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" event={"ID":"dd6813bb-8191-40c6-b6d8-8672a77a7a2a","Type":"ContainerStarted","Data":"a811f7ab9f8a7d5df195ebc9e837470d476bfc5157660e88530370532281ea53"} Jul 27 09:27:07.191206 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:07.191146 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-nrplz" podStartSLOduration=1.462258487 podStartE2EDuration="3.191130544s" totalImagesPullingTime="1.728872057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:07.189900193 +0000 UTC m=+148.099074769" watchObservedRunningTime="2026-07-27 09:27:07.191130544 +0000 UTC m=+148.100305120" Jul 27 09:27:08.383708 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:08.383669 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:08.384117 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:08.383747 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:08.384117 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:08.383794 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 09:27:08.384117 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:08.383858 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:08.384117 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:08.383867 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:16.383850108 +0000 UTC m=+157.293024664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : configmap "kube-rbac-proxy" not found Jul 27 09:27:08.384117 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:08.383899 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:16.383886444 +0000 UTC m=+157.293060999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:12.817283 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:12.817218 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:12.817665 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:12.817303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:12.817665 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:12.817445 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle podName:5dbbf837-e495-4924-b9ab-5df52e6cb9f1 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:28.817429422 +0000 UTC m=+169.726603994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle") pod "router-default-bfff56479-vns8n" (UID: "5dbbf837-e495-4924-b9ab-5df52e6cb9f1") : configmap references non-existent config key: service-ca.crt Jul 27 09:27:12.819580 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:12.819558 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-metrics-certs\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:16.446148 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:16.446113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:16.446596 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:16.446292 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 09:27:16.446596 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:16.446354 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls podName:0ec34077-063b-4ee7-9733-240e62fe92cb nodeName:}" failed. No retries permitted until 2026-07-27 09:27:32.446340273 +0000 UTC m=+173.355514828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgwqr" (UID: "0ec34077-063b-4ee7-9733-240e62fe92cb") : secret "insights-runtime-extractor-tls" not found Jul 27 09:27:16.446596 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:16.446292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:16.446799 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:16.446749 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ec34077-063b-4ee7-9733-240e62fe92cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:17.966700 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:17.966653 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r7r26" podUID="738f5986-5028-4703-b421-e09472c0e04f" Jul 27 09:27:18.210316 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:18.210284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:19.622317 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:19.622279 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gr66c" podUID="2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08" Jul 27 09:27:22.893996 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:22.893949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:22.896193 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:22.896173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/738f5986-5028-4703-b421-e09472c0e04f-metrics-tls\") pod \"dns-default-r7r26\" (UID: \"738f5986-5028-4703-b421-e09472c0e04f\") " pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:23.013809 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:23.013775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v4cq5\"" Jul 27 09:27:23.022369 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:23.022342 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:23.156325 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:23.154909 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r7r26"] Jul 27 09:27:23.160082 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:23.160049 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738f5986_5028_4703_b421_e09472c0e04f.slice/crio-6686de5461bd8dd4544b05291d11da4f0341f74bc61404d99e53e83c3d7f697e WatchSource:0}: Error finding container 6686de5461bd8dd4544b05291d11da4f0341f74bc61404d99e53e83c3d7f697e: Status 404 returned error can't find the container with id 6686de5461bd8dd4544b05291d11da4f0341f74bc61404d99e53e83c3d7f697e Jul 27 09:27:23.226145 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:23.226100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7r26" event={"ID":"738f5986-5028-4703-b421-e09472c0e04f","Type":"ContainerStarted","Data":"6686de5461bd8dd4544b05291d11da4f0341f74bc61404d99e53e83c3d7f697e"} Jul 27 09:27:25.234836 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:25.234744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7r26" event={"ID":"738f5986-5028-4703-b421-e09472c0e04f","Type":"ContainerStarted","Data":"0ea1c125854c34ebace2bb77835617c757285260b66cc8b6efc914c5919b1e09"} Jul 27 09:27:25.234836 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:25.234800 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r7r26" event={"ID":"738f5986-5028-4703-b421-e09472c0e04f","Type":"ContainerStarted","Data":"b37759cea3818db8752663dbdc87e15f71baaf08dcc164d644ed55c960c1a832"} Jul 27 09:27:25.235400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:25.234876 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:25.255081 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:25.255026 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r7r26" podStartSLOduration=129.484920018 podStartE2EDuration="2m11.255010768s" totalImagesPullingTime="1.77009075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:25.254401208 +0000 UTC m=+166.163575785" watchObservedRunningTime="2026-07-27 09:27:25.255010768 +0000 UTC m=+166.164185343" Jul 27 09:27:28.834884 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:28.834838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:28.835647 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:28.835624 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dbbf837-e495-4924-b9ab-5df52e6cb9f1-service-ca-bundle\") pod \"router-default-bfff56479-vns8n\" (UID: \"5dbbf837-e495-4924-b9ab-5df52e6cb9f1\") " pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:29.104265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:29.104153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:29.230270 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:29.230224 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bfff56479-vns8n"] Jul 27 09:27:29.233548 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:29.233509 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbbf837_e495_4924_b9ab_5df52e6cb9f1.slice/crio-c4363f8502bc1faba83305b5580000575367f6e455df98f7c9cc4fcf98aa703d WatchSource:0}: Error finding container c4363f8502bc1faba83305b5580000575367f6e455df98f7c9cc4fcf98aa703d: Status 404 returned error can't find the container with id c4363f8502bc1faba83305b5580000575367f6e455df98f7c9cc4fcf98aa703d Jul 27 09:27:29.251742 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:29.251708 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bfff56479-vns8n" event={"ID":"5dbbf837-e495-4924-b9ab-5df52e6cb9f1","Type":"ContainerStarted","Data":"c4363f8502bc1faba83305b5580000575367f6e455df98f7c9cc4fcf98aa703d"} Jul 27 09:27:30.255764 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:30.255727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bfff56479-vns8n" event={"ID":"5dbbf837-e495-4924-b9ab-5df52e6cb9f1","Type":"ContainerStarted","Data":"6e064d4fb82c78ff87d22d631c609d917434bb5f5e70f0197d4e0681ac3c169f"} Jul 27 09:27:30.276304 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:30.276249 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bfff56479-vns8n" podStartSLOduration=34.276215049 podStartE2EDuration="34.276215049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:30.275207469 +0000 UTC m=+171.184382069" watchObservedRunningTime="2026-07-27 09:27:30.276215049 +0000 UTC m=+171.185389666" Jul 27 09:27:31.104692 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.104649 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:31.107295 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.107271 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:31.259390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.259354 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:31.260635 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.260616 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bfff56479-vns8n" Jul 27 09:27:31.879874 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.879834 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh"] Jul 27 09:27:31.881826 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.881808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:31.883973 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.883949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 27 09:27:31.884100 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.883992 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ntz9t\"" Jul 27 09:27:31.890527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.890498 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh"] Jul 27 09:27:31.957179 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:31.957140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d301ca21-3389-47ef-b3fe-377e6236ce38-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vwrkh\" (UID: \"d301ca21-3389-47ef-b3fe-377e6236ce38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:32.057808 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.057761 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d301ca21-3389-47ef-b3fe-377e6236ce38-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vwrkh\" (UID: \"d301ca21-3389-47ef-b3fe-377e6236ce38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:32.060209 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.060180 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d301ca21-3389-47ef-b3fe-377e6236ce38-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-vwrkh\" (UID: \"d301ca21-3389-47ef-b3fe-377e6236ce38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:32.191472 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.191367 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:32.317766 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.317735 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh"] Jul 27 09:27:32.321841 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:32.321818 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd301ca21_3389_47ef_b3fe_377e6236ce38.slice/crio-7f4638c150c7fef3330f5884dfda9229a05848a7e3f1355443d49d79f1fbd3f5 WatchSource:0}: Error finding container 7f4638c150c7fef3330f5884dfda9229a05848a7e3f1355443d49d79f1fbd3f5: Status 404 returned error can't find the container with id 7f4638c150c7fef3330f5884dfda9229a05848a7e3f1355443d49d79f1fbd3f5 Jul 27 09:27:32.460891 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.460790 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:32.463109 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.463090 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ec34077-063b-4ee7-9733-240e62fe92cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgwqr\" (UID: \"0ec34077-063b-4ee7-9733-240e62fe92cb\") " pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:32.611458 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.611413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:27:32.754516 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.754417 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgwqr" Jul 27 09:27:32.909300 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:32.909266 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgwqr"] Jul 27 09:27:32.912787 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:32.912752 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec34077_063b_4ee7_9733_240e62fe92cb.slice/crio-cc926c7f68c612b4f93e7469938f24eb6ac162050a536d188b1ad9064e5f176a WatchSource:0}: Error finding container cc926c7f68c612b4f93e7469938f24eb6ac162050a536d188b1ad9064e5f176a: Status 404 returned error can't find the container with id cc926c7f68c612b4f93e7469938f24eb6ac162050a536d188b1ad9064e5f176a Jul 27 09:27:33.267661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:33.267618 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" event={"ID":"d301ca21-3389-47ef-b3fe-377e6236ce38","Type":"ContainerStarted","Data":"7f4638c150c7fef3330f5884dfda9229a05848a7e3f1355443d49d79f1fbd3f5"} Jul 27 09:27:33.268869 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:33.268838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgwqr" event={"ID":"0ec34077-063b-4ee7-9733-240e62fe92cb","Type":"ContainerStarted","Data":"cc926c7f68c612b4f93e7469938f24eb6ac162050a536d188b1ad9064e5f176a"} Jul 27 09:27:34.274934 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:34.274895 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" event={"ID":"d301ca21-3389-47ef-b3fe-377e6236ce38","Type":"ContainerStarted","Data":"16bfab0846d66529650a6aeb4279162b6a3f634cbdbd9f8c0ea22321d12160ff"} Jul 27 09:27:34.275457 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:34.275148 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:34.280528 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:34.280499 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" Jul 27 09:27:34.292521 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:34.292462 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-vwrkh" podStartSLOduration=2.221569231 podStartE2EDuration="3.292440794s" totalImagesPullingTime="1.070871563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:34.291307424 +0000 UTC m=+175.200482020" watchObservedRunningTime="2026-07-27 09:27:34.292440794 +0000 UTC m=+175.201615369" Jul 27 09:27:35.240943 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:35.240912 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r7r26" Jul 27 09:27:38.292193 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:38.292132 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgwqr" event={"ID":"0ec34077-063b-4ee7-9733-240e62fe92cb","Type":"ContainerStarted","Data":"ef8639ebde50b0256e54269dac3340af108136c85b0d2db4b06e32ea80189967"} Jul 27 09:27:41.304461 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:41.304364 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgwqr" event={"ID":"0ec34077-063b-4ee7-9733-240e62fe92cb","Type":"ContainerStarted","Data":"e0841c55180b7a1fcc72378a2c09bc6ba54b57a154192d05e5346c658c9fc629"} Jul 27 09:27:42.363023 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.362986 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf"] Jul 27 09:27:42.366635 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.366602 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.369024 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.368836 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 09:27:42.369836 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.369409 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 09:27:42.369950 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.369856 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lshw4\"" Jul 27 09:27:42.370012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.369978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 09:27:42.370136 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.370066 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 09:27:42.370136 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.370216 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 09:27:42.379767 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.379739 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf"] Jul 27 09:27:42.423012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.422396 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d8pxp"] Jul 27 09:27:42.426283 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.426259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.429641 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.429438 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fp6tz\"" Jul 27 09:27:42.430048 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.429908 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 09:27:42.430048 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.429933 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 09:27:42.432668 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.432643 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 09:27:42.446711 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.446683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4hsm\" (UniqueName: \"kubernetes.io/projected/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-kube-api-access-w4hsm\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.446886 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.446750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.446886 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.446817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.446886 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.446847 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.548166 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548364 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.548364 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-metrics-client-ca\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548364 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-textfile\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548459 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzhv\" (UniqueName: \"kubernetes.io/projected/4f04cbea-cced-4359-b747-fb1127be8df4-kube-api-access-8tzhv\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-sys\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548527 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548821 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-root\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548821 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-wtmp\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.548821 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.548615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4hsm\" (UniqueName: \"kubernetes.io/projected/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-kube-api-access-w4hsm\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.549185 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.549159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.551514 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.551489 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.553290 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.553263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.559268 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.559203 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4hsm\" (UniqueName: \"kubernetes.io/projected/8e5b4754-97d0-441e-b93b-88ae1d4ecf27-kube-api-access-w4hsm\") pod \"openshift-state-metrics-b8f49f5c6-v6vmf\" (UID: \"8e5b4754-97d0-441e-b93b-88ae1d4ecf27\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.649614 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-metrics-client-ca\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649614 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-textfile\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzhv\" (UniqueName: \"kubernetes.io/projected/4f04cbea-cced-4359-b747-fb1127be8df4-kube-api-access-8tzhv\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-sys\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-root\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-wtmp\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.649878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.649795 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650227 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650202 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-metrics-client-ca\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650440 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-accelerators-collector-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650440 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650429 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-sys\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650491 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-textfile\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650560 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:42.650506 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 09:27:42.650560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650548 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-root\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.650703 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:42.650557 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls podName:4f04cbea-cced-4359-b747-fb1127be8df4 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:43.150540034 +0000 UTC m=+184.059714601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls") pod "node-exporter-d8pxp" (UID: "4f04cbea-cced-4359-b747-fb1127be8df4") : secret "node-exporter-tls" not found Jul 27 09:27:42.650703 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.650663 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-wtmp\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.654700 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.653414 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.669998 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.669932 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzhv\" (UniqueName: \"kubernetes.io/projected/4f04cbea-cced-4359-b747-fb1127be8df4-kube-api-access-8tzhv\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:42.680996 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.680848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" Jul 27 09:27:42.851336 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:42.850592 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf"] Jul 27 09:27:42.856550 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:42.856511 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5b4754_97d0_441e_b93b_88ae1d4ecf27.slice/crio-548a6dca8d2f8dab5c45eadb4c59dd7a58468457cd200617a933ee7d939fe9fe WatchSource:0}: Error finding container 548a6dca8d2f8dab5c45eadb4c59dd7a58468457cd200617a933ee7d939fe9fe: Status 404 returned error can't find the container with id 548a6dca8d2f8dab5c45eadb4c59dd7a58468457cd200617a933ee7d939fe9fe Jul 27 09:27:43.156423 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.156383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:43.156620 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:43.156565 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 09:27:43.156688 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:43.156646 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls podName:4f04cbea-cced-4359-b747-fb1127be8df4 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:44.156625918 +0000 UTC m=+185.065800488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls") pod "node-exporter-d8pxp" (UID: "4f04cbea-cced-4359-b747-fb1127be8df4") : secret "node-exporter-tls" not found Jul 27 09:27:43.317219 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.317029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" event={"ID":"8e5b4754-97d0-441e-b93b-88ae1d4ecf27","Type":"ContainerStarted","Data":"133b1c4fcc64f93f2f4d842dd07f89479689d31706a00ce2fe91066a1797ba7e"} Jul 27 09:27:43.317219 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.317104 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" event={"ID":"8e5b4754-97d0-441e-b93b-88ae1d4ecf27","Type":"ContainerStarted","Data":"5eafeb41905c1678de8e27bf74dca2ae89d05e8986aa038854527c6c3d7bf4b9"} Jul 27 09:27:43.317219 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.317141 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" event={"ID":"8e5b4754-97d0-441e-b93b-88ae1d4ecf27","Type":"ContainerStarted","Data":"548a6dca8d2f8dab5c45eadb4c59dd7a58468457cd200617a933ee7d939fe9fe"} Jul 27 09:27:43.465929 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.465895 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:27:43.477594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.477567 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.481304 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481255 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 09:27:43.481304 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481282 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 09:27:43.481504 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481328 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 09:27:43.481504 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481282 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 09:27:43.481866 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 09:27:43.481992 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481928 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hp8br\"" Jul 27 09:27:43.481992 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.481957 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 09:27:43.482117 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.482059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 09:27:43.482117 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.482078 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 09:27:43.482408 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.482391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 09:27:43.491084 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.491059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:27:43.559648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.559896 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.560541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.560541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.560541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.559999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.560541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.560022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzf2v\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661193 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661193 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661454 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661454 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:43.661381 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle podName:dbe345dc-d651-423a-995f-289a9e21d695 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:44.161359981 +0000 UTC m=+185.070534535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dbe345dc-d651-423a-995f-289a9e21d695") : configmap references non-existent config key: ca-bundle.crt Jul 27 09:27:43.661454 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661616 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661616 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661616 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661616 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzf2v\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.661810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.661734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.662679 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.662631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.663063 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.663035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.664899 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.664854 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.665171 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.665130 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.665317 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.665297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.665848 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.665805 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.665975 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.665946 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.666307 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.666283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.666687 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.666667 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.667020 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.666926 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.667342 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.667321 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:43.675182 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:43.675033 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzf2v\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:44.165774 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.165733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:44.165961 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.165799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:44.166608 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.166584 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:44.168211 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.168191 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f04cbea-cced-4359-b747-fb1127be8df4-node-exporter-tls\") pod \"node-exporter-d8pxp\" (UID: \"4f04cbea-cced-4359-b747-fb1127be8df4\") " pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:44.237606 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.237560 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d8pxp" Jul 27 09:27:44.390059 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.390021 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:27:44.439650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.439565 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-695f997678-njng9"] Jul 27 09:27:44.445524 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.445495 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.447975 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.447986 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.448017 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2u42h4mqqsbht\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.447986 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4zkp9\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.448074 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.448066 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 09:27:44.448215 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.448128 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 09:27:44.458749 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.458726 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-695f997678-njng9"] Jul 27 09:27:44.569537 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-grpc-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b720ff45-abed-4795-9ba2-1b3e3f1cba34-metrics-client-ca\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.569920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.569781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kc7l\" (UniqueName: \"kubernetes.io/projected/b720ff45-abed-4795-9ba2-1b3e3f1cba34-kube-api-access-9kc7l\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.611847 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:44.611811 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f04cbea_cced_4359_b747_fb1127be8df4.slice/crio-31b56da580066b973d7337d4051f877d123ab625babff317961c53e92cc45eec WatchSource:0}: Error finding container 31b56da580066b973d7337d4051f877d123ab625babff317961c53e92cc45eec: Status 404 returned error can't find the container with id 31b56da580066b973d7337d4051f877d123ab625babff317961c53e92cc45eec Jul 27 09:27:44.670298 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670397 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b720ff45-abed-4795-9ba2-1b3e3f1cba34-metrics-client-ca\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670397 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670397 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670397 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670593 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kc7l\" (UniqueName: \"kubernetes.io/projected/b720ff45-abed-4795-9ba2-1b3e3f1cba34-kube-api-access-9kc7l\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670593 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-grpc-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.670593 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.670538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.671177 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.671127 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b720ff45-abed-4795-9ba2-1b3e3f1cba34-metrics-client-ca\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.673132 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.673106 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.673428 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.673402 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.673599 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.673540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-grpc-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.674003 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.673983 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-tls\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.674087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.674040 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.674087 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.674043 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b720ff45-abed-4795-9ba2-1b3e3f1cba34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.680917 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.680893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kc7l\" (UniqueName: \"kubernetes.io/projected/b720ff45-abed-4795-9ba2-1b3e3f1cba34-kube-api-access-9kc7l\") pod \"thanos-querier-695f997678-njng9\" (UID: \"b720ff45-abed-4795-9ba2-1b3e3f1cba34\") " pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.745402 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.745375 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:27:44.746740 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:44.746716 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe345dc_d651_423a_995f_289a9e21d695.slice/crio-a6a7db91392dae808a6d0eea87f589ceba2fec1fba5f9ff39b220dc204acb9ff WatchSource:0}: Error finding container a6a7db91392dae808a6d0eea87f589ceba2fec1fba5f9ff39b220dc204acb9ff: Status 404 returned error can't find the container with id a6a7db91392dae808a6d0eea87f589ceba2fec1fba5f9ff39b220dc204acb9ff Jul 27 09:27:44.757286 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.757266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:44.900658 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:44.900485 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-695f997678-njng9"] Jul 27 09:27:44.903324 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:44.903301 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb720ff45_abed_4795_9ba2_1b3e3f1cba34.slice/crio-7ec4d17c366a4fd53965ce4dca810b6a65ffe6de9c3b68026d86dc9c1715cb94 WatchSource:0}: Error finding container 7ec4d17c366a4fd53965ce4dca810b6a65ffe6de9c3b68026d86dc9c1715cb94: Status 404 returned error can't find the container with id 7ec4d17c366a4fd53965ce4dca810b6a65ffe6de9c3b68026d86dc9c1715cb94 Jul 27 09:27:45.329314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.329263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" event={"ID":"8e5b4754-97d0-441e-b93b-88ae1d4ecf27","Type":"ContainerStarted","Data":"04545d1bd20d47de97b48603845b3fbf1c60954e9d847247ff846905219bdfd3"} Jul 27 09:27:45.330815 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.330787 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8pxp" event={"ID":"4f04cbea-cced-4359-b747-fb1127be8df4","Type":"ContainerStarted","Data":"31b56da580066b973d7337d4051f877d123ab625babff317961c53e92cc45eec"} Jul 27 09:27:45.333175 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.333115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgwqr" event={"ID":"0ec34077-063b-4ee7-9733-240e62fe92cb","Type":"ContainerStarted","Data":"54e49ee9795af9086fe6aaa7b10280264d78a6af847065810ad2c306f9e2a148"} Jul 27 09:27:45.335074 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.334987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"7ec4d17c366a4fd53965ce4dca810b6a65ffe6de9c3b68026d86dc9c1715cb94"} Jul 27 09:27:45.336298 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.336273 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"a6a7db91392dae808a6d0eea87f589ceba2fec1fba5f9ff39b220dc204acb9ff"} Jul 27 09:27:45.350893 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.350643 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v6vmf" podStartSLOduration=1.102664761 podStartE2EDuration="3.350626761s" totalImagesPullingTime="2.247962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:45.35025068 +0000 UTC m=+186.259425255" watchObservedRunningTime="2026-07-27 09:27:45.350626761 +0000 UTC m=+186.259801339" Jul 27 09:27:45.371519 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:45.371466 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bgwqr" podStartSLOduration=33.742880498 podStartE2EDuration="45.371446682s" totalImagesPullingTime="11.628566184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:27:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:45.370672299 +0000 UTC m=+186.279846875" watchObservedRunningTime="2026-07-27 09:27:45.371446682 +0000 UTC m=+186.280621261" Jul 27 09:27:46.341817 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:46.341737 2566 generic.go:356] "Generic (PLEG): container finished" podID="4f04cbea-cced-4359-b747-fb1127be8df4" containerID="5386503082a11462e5375c17d14215aa44a6c3f8668ea06b279403d983f21fa8" exitCode=0 Jul 27 09:27:46.341817 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:46.341767 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8pxp" event={"ID":"4f04cbea-cced-4359-b747-fb1127be8df4","Type":"ContainerDied","Data":"5386503082a11462e5375c17d14215aa44a6c3f8668ea06b279403d983f21fa8"} Jul 27 09:27:46.343468 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:46.343446 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172" exitCode=0 Jul 27 09:27:46.343561 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:46.343537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172"} Jul 27 09:27:47.170884 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.170845 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj"] Jul 27 09:27:47.174505 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.174467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.179350 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.179299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 09:27:47.179490 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.179392 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7689w\"" Jul 27 09:27:47.195620 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.195561 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj"] Jul 27 09:27:47.294002 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.293962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.294176 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.294011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flbq\" (UniqueName: \"kubernetes.io/projected/e6d394e5-98b1-4609-98c1-b5c571dd65d9-kube-api-access-6flbq\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.350412 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.350376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8pxp" event={"ID":"4f04cbea-cced-4359-b747-fb1127be8df4","Type":"ContainerStarted","Data":"0b5022c9a8950e297665d64ae507e69e0361b422b1ce8975dfd752bb8e9b294a"} Jul 27 09:27:47.350805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.350435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d8pxp" event={"ID":"4f04cbea-cced-4359-b747-fb1127be8df4","Type":"ContainerStarted","Data":"5bb1a1d0fc3c91b628ed09c85dc90869245f37cd7b8898ee39cf5566106e12ba"} Jul 27 09:27:47.376762 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.376705 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d8pxp" podStartSLOduration=3.975734963 podStartE2EDuration="5.376689588s" totalImagesPullingTime="1.325938142s" totalInitContainerRuntime="75.016483ms" isStatefulPod=true podCreationTimestamp="2026-07-27 09:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:47.374880378 +0000 UTC m=+188.284054955" watchObservedRunningTime="2026-07-27 09:27:47.376689588 +0000 UTC m=+188.285864164" Jul 27 09:27:47.395302 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.395269 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.395459 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.395314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flbq\" (UniqueName: \"kubernetes.io/projected/e6d394e5-98b1-4609-98c1-b5c571dd65d9-kube-api-access-6flbq\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.395459 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:47.395431 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 09:27:47.395570 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:27:47.395508 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert podName:e6d394e5-98b1-4609-98c1-b5c571dd65d9 nodeName:}" failed. No retries permitted until 2026-07-27 09:27:47.89548769 +0000 UTC m=+188.804662258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-f5zxj" (UID: "e6d394e5-98b1-4609-98c1-b5c571dd65d9") : secret "monitoring-plugin-cert" not found Jul 27 09:27:47.412997 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.412973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flbq\" (UniqueName: \"kubernetes.io/projected/e6d394e5-98b1-4609-98c1-b5c571dd65d9-kube-api-access-6flbq\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.900778 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.900527 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:47.903278 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:47.903255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6d394e5-98b1-4609-98c1-b5c571dd65d9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-f5zxj\" (UID: \"e6d394e5-98b1-4609-98c1-b5c571dd65d9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:48.087610 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.087579 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:48.214589 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.214510 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj"] Jul 27 09:27:48.217262 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:48.217213 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d394e5_98b1_4609_98c1_b5c571dd65d9.slice/crio-12d16bc29bbe834ed17f76e2a1526008415d246608cb5b9e2b346f4603d9e6b3 WatchSource:0}: Error finding container 12d16bc29bbe834ed17f76e2a1526008415d246608cb5b9e2b346f4603d9e6b3: Status 404 returned error can't find the container with id 12d16bc29bbe834ed17f76e2a1526008415d246608cb5b9e2b346f4603d9e6b3 Jul 27 09:27:48.356308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.356277 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"75bb9c6ffb94084a097932aec18b390f4eeb8fe122fdc5a7e1e881604ed7eb08"} Jul 27 09:27:48.356669 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.356351 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"d5721a3053bc9a1767a1ebabb0ab409e07915cba3832f2133d67af983f3f95b7"} Jul 27 09:27:48.356669 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.356383 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"f83b8d21d79b9392f69d6e0d931c39329946730219a93ac9f42120d6b1a8a1ed"} Jul 27 09:27:48.359028 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.359000 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d"} Jul 27 09:27:48.359146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.359059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042"} Jul 27 09:27:48.359146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.359101 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c"} Jul 27 09:27:48.359146 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.359127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7"} Jul 27 09:27:48.359279 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.359151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e"} Jul 27 09:27:48.360081 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.360048 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" event={"ID":"e6d394e5-98b1-4609-98c1-b5c571dd65d9","Type":"ContainerStarted","Data":"12d16bc29bbe834ed17f76e2a1526008415d246608cb5b9e2b346f4603d9e6b3"} Jul 27 09:27:48.640920 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.640884 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:27:48.644616 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.644599 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.647828 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.647809 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 09:27:48.648096 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.648077 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 09:27:48.651039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.650917 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 09:27:48.651039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.650974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-av2shm5rn558u\"" Jul 27 09:27:48.651039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.650974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 09:27:48.651039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.650994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 09:27:48.651323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.650987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 09:27:48.651323 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 09:27:48.651774 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651482 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 09:27:48.651774 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651507 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 09:27:48.651774 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651628 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 09:27:48.651774 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651739 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 09:27:48.652043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651787 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gpcjw\"" Jul 27 09:27:48.652043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651852 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 09:27:48.652043 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.651854 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 09:27:48.652244 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.652207 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 09:27:48.653016 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.652999 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 09:27:48.665669 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.665645 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:27:48.708047 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708151 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708151 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708151 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708321 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708321 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708419 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708497 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708497 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdcv\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708619 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708619 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708619 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708755 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708802 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708802 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708888 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708888 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.708888 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.709002 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.709002 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.708955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809429 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809575 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809575 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809692 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809692 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809629 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.809692 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810004 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.809981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810071 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810072 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdcv\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810435 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810518 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810518 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810707 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810710 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810737 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.810800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.810773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.811480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.811154 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.811480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.811365 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.811795 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.811773 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.814039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.813478 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.814039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.813571 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.814039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.813682 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.814039 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.813967 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.814301 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.814179 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.815521 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.815021 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.815521 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.815459 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.815673 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.815557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.816086 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.816049 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.816168 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.816106 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.816246 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.816207 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.816315 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.816292 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.816510 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.816490 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.818445 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.818424 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.822081 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.822061 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdcv\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv\") pod \"prometheus-k8s-0\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:48.954468 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:48.954435 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:49.099987 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.099955 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:27:49.103061 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:27:49.103033 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe29e42_5ee2_4e84_bc23_9c4b7d9e7db7.slice/crio-3844ad9edf41626301b40d435d540d6450ec2239483fa426e53674b083e88328 WatchSource:0}: Error finding container 3844ad9edf41626301b40d435d540d6450ec2239483fa426e53674b083e88328: Status 404 returned error can't find the container with id 3844ad9edf41626301b40d435d540d6450ec2239483fa426e53674b083e88328 Jul 27 09:27:49.366494 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.366451 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4" exitCode=0 Jul 27 09:27:49.366916 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.366533 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4"} Jul 27 09:27:49.366916 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.366605 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"3844ad9edf41626301b40d435d540d6450ec2239483fa426e53674b083e88328"} Jul 27 09:27:49.375171 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.375139 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"d253202bb1b691b0824287e87efc651f30ba7ae55bbfc5eeb57857d63e2c8fa7"} Jul 27 09:27:49.375291 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.375266 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"6135f41888e8ef4ea1c27bacfc5be80f5d54a237fad1904b2e18437120a2f123"} Jul 27 09:27:49.375368 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.375303 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-695f997678-njng9" event={"ID":"b720ff45-abed-4795-9ba2-1b3e3f1cba34","Type":"ContainerStarted","Data":"cc4df67f57d8e96da8012f1ea10f69669a7c9dc64d3e5f80fdcc8aebedccec3f"} Jul 27 09:27:49.375455 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.375435 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:27:49.378810 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.378784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerStarted","Data":"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc"} Jul 27 09:27:49.425293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.425184 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.132269743 podStartE2EDuration="6.425163859s" totalImagesPullingTime="3.269795555s" totalInitContainerRuntime="23.098561ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:49.423599766 +0000 UTC m=+190.332774372" watchObservedRunningTime="2026-07-27 09:27:49.425163859 +0000 UTC m=+190.334338435" Jul 27 09:27:49.448308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:49.448252 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-695f997678-njng9" podStartSLOduration=1.8590227430000001 podStartE2EDuration="5.448221072s" totalImagesPullingTime="3.589198329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:49.446611294 +0000 UTC m=+190.355785882" watchObservedRunningTime="2026-07-27 09:27:49.448221072 +0000 UTC m=+190.357395680" Jul 27 09:27:50.385571 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:50.385533 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" event={"ID":"e6d394e5-98b1-4609-98c1-b5c571dd65d9","Type":"ContainerStarted","Data":"d76ad0848c4525aa4963011070a64c07969942f9a1ecc57de9d8f241631c771b"} Jul 27 09:27:50.386025 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:50.385917 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:50.391424 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:50.391398 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" Jul 27 09:27:50.404294 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:50.404249 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-f5zxj" podStartSLOduration=1.9567131359999999 podStartE2EDuration="3.404218062s" totalImagesPullingTime="1.447504926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:50.402969209 +0000 UTC m=+191.312143799" watchObservedRunningTime="2026-07-27 09:27:50.404218062 +0000 UTC m=+191.313392638" Jul 27 09:27:53.401303 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401259 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492"} Jul 27 09:27:53.401800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572"} Jul 27 09:27:53.401800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22"} Jul 27 09:27:53.401800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401440 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba"} Jul 27 09:27:53.401800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401482 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301"} Jul 27 09:27:53.401800 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.401521 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerStarted","Data":"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51"} Jul 27 09:27:53.433887 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.433837 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.386746707 podStartE2EDuration="5.433821219s" totalImagesPullingTime="3.031320929s" totalInitContainerRuntime="15.753583ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:27:53.431562642 +0000 UTC m=+194.340737239" watchObservedRunningTime="2026-07-27 09:27:53.433821219 +0000 UTC m=+194.342995821" Jul 27 09:27:53.954981 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:53.954951 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:27:55.393316 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:27:55.393285 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-695f997678-njng9" Jul 27 09:28:30.551368 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:30.551332 2566 generic.go:356] "Generic (PLEG): container finished" podID="3d46ee64-9dd3-4c64-ad72-3b61256378eb" containerID="ec665c1b920975f8429ccb53ba897b6dfddad532102f82c37205b56d9b8b4455" exitCode=0 Jul 27 09:28:30.551771 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:30.551405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jqscl" event={"ID":"3d46ee64-9dd3-4c64-ad72-3b61256378eb","Type":"ContainerDied","Data":"ec665c1b920975f8429ccb53ba897b6dfddad532102f82c37205b56d9b8b4455"} Jul 27 09:28:30.551771 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:30.551743 2566 scope.go:117] "RemoveContainer" containerID="ec665c1b920975f8429ccb53ba897b6dfddad532102f82c37205b56d9b8b4455" Jul 27 09:28:31.557047 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:31.557010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jqscl" event={"ID":"3d46ee64-9dd3-4c64-ad72-3b61256378eb","Type":"ContainerStarted","Data":"9866d00cfb2c547c92caab2f173721ada7cdcf35311b4ed41be2c666e21b1206"} Jul 27 09:28:48.955667 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:48.955625 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:28:48.971380 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:48.971350 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:28:49.643659 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:49.643631 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:28:51.371500 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:51.371464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:28:51.373719 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:51.373696 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08-metrics-certs\") pod \"network-metrics-daemon-gr66c\" (UID: \"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08\") " pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:28:51.514588 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:51.514559 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fpm4f\"" Jul 27 09:28:51.522241 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:51.522215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr66c" Jul 27 09:28:51.657009 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:51.656913 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gr66c"] Jul 27 09:28:51.660009 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:28:51.659983 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2de8bf_85f8_43ec_82ae_e3fd8a99bb08.slice/crio-dfba6b6765a26ccd75d268d76c272788e18bf24e22c60554cd44ea730b727669 WatchSource:0}: Error finding container dfba6b6765a26ccd75d268d76c272788e18bf24e22c60554cd44ea730b727669: Status 404 returned error can't find the container with id dfba6b6765a26ccd75d268d76c272788e18bf24e22c60554cd44ea730b727669 Jul 27 09:28:52.641259 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:52.641205 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr66c" event={"ID":"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08","Type":"ContainerStarted","Data":"dcae389addd9329d66e22e24500bed77cd8c473c6575a2e9ee9f06fc2e4d2686"} Jul 27 09:28:52.641628 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:52.641292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr66c" event={"ID":"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08","Type":"ContainerStarted","Data":"dfba6b6765a26ccd75d268d76c272788e18bf24e22c60554cd44ea730b727669"} Jul 27 09:28:53.646721 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:53.646681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr66c" event={"ID":"2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08","Type":"ContainerStarted","Data":"f4b5d67bf5162261f68bd52ae62b546f1236db218fd11117928c53fdc0a4a4b3"} Jul 27 09:28:53.669355 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:28:53.669294 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gr66c" podStartSLOduration=252.789541277 podStartE2EDuration="4m13.669279195s" totalImagesPullingTime="879.737918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:28:53.66759388 +0000 UTC m=+254.576768481" watchObservedRunningTime="2026-07-27 09:28:53.669279195 +0000 UTC m=+254.578453857" Jul 27 09:29:02.687125 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687046 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687321 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="alertmanager" containerID="cri-o://c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" gracePeriod=120 Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687352 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy" containerID="cri-o://7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" gracePeriod=120 Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687395 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="config-reloader" containerID="cri-o://5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" gracePeriod=120 Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687345 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="prom-label-proxy" containerID="cri-o://9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" gracePeriod=120 Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687356 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-web" containerID="cri-o://227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" gracePeriod=120 Jul 27 09:29:02.687680 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:02.687411 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-metric" containerID="cri-o://7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" gracePeriod=120 Jul 27 09:29:03.692041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692008 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" exitCode=0 Jul 27 09:29:03.692041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692034 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" exitCode=0 Jul 27 09:29:03.692041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692042 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" exitCode=0 Jul 27 09:29:03.692041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692050 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" exitCode=0 Jul 27 09:29:03.692511 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc"} Jul 27 09:29:03.692511 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042"} Jul 27 09:29:03.692511 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7"} Jul 27 09:29:03.692511 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.692178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e"} Jul 27 09:29:03.938995 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.938967 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:03.979960 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.979869 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.979960 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.979914 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzf2v\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.979960 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.979954 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980255 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980130 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980255 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980170 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980255 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980209 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980262 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980290 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980323 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980379 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980438 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980410 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980693 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980461 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980693 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980511 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbe345dc-d651-423a-995f-289a9e21d695\" (UID: \"dbe345dc-d651-423a-995f-289a9e21d695\") " Jul 27 09:29:03.980693 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980674 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:29:03.980845 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.980833 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-main-db\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:03.981635 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.981361 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:03.981635 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.981611 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:03.983783 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.983729 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out" (OuterVolumeSpecName: "config-out") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:29:03.984276 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.984020 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.984276 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.984111 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v" (OuterVolumeSpecName: "kube-api-access-jzf2v") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "kube-api-access-jzf2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:29:03.984276 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.984195 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.984632 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.984592 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:29:03.985378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.985351 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.985754 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.985660 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.986007 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.985971 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.989164 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.989137 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:03.996041 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:03.996012 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config" (OuterVolumeSpecName: "web-config") pod "dbe345dc-d651-423a-995f-289a9e21d695" (UID: "dbe345dc-d651-423a-995f-289a9e21d695"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:04.082105 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082069 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082105 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082101 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-cluster-tls-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082105 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082111 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082122 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082132 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-secret-alertmanager-main-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082141 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzf2v\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-kube-api-access-jzf2v\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082150 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe345dc-d651-423a-995f-289a9e21d695-tls-assets\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082178 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-web-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082186 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe345dc-d651-423a-995f-289a9e21d695-config-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082196 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe345dc-d651-423a-995f-289a9e21d695-config-out\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082203 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-metrics-client-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.082378 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.082211 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe345dc-d651-423a-995f-289a9e21d695-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:04.699080 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699041 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" exitCode=0 Jul 27 09:29:04.699080 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699072 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbe345dc-d651-423a-995f-289a9e21d695" containerID="227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" exitCode=0 Jul 27 09:29:04.699570 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699109 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.699570 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699112 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d"} Jul 27 09:29:04.699570 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c"} Jul 27 09:29:04.699570 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe345dc-d651-423a-995f-289a9e21d695","Type":"ContainerDied","Data":"a6a7db91392dae808a6d0eea87f589ceba2fec1fba5f9ff39b220dc204acb9ff"} Jul 27 09:29:04.699570 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.699259 2566 scope.go:117] "RemoveContainer" containerID="9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" Jul 27 09:29:04.707725 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.707707 2566 scope.go:117] "RemoveContainer" containerID="7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" Jul 27 09:29:04.715131 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.715113 2566 scope.go:117] "RemoveContainer" containerID="7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" Jul 27 09:29:04.722116 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.722085 2566 scope.go:117] "RemoveContainer" containerID="227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" Jul 27 09:29:04.725645 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.725620 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:04.730343 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.730320 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:04.731906 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.731883 2566 scope.go:117] "RemoveContainer" containerID="5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" Jul 27 09:29:04.744082 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.744046 2566 scope.go:117] "RemoveContainer" containerID="c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" Jul 27 09:29:04.752006 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.751984 2566 scope.go:117] "RemoveContainer" containerID="2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172" Jul 27 09:29:04.756869 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.756843 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:04.757287 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757269 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-metric" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757290 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-metric" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757310 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="alertmanager" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757319 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="alertmanager" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757333 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757339 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757347 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-web" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757353 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-web" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757362 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="prom-label-proxy" Jul 27 09:29:04.757365 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757367 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="prom-label-proxy" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757375 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="config-reloader" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757380 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="config-reloader" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757389 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="init-config-reloader" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757396 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="init-config-reloader" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757481 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="prom-label-proxy" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757493 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-metric" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757502 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="alertmanager" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757510 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy-web" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757516 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="config-reloader" Jul 27 09:29:04.757739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.757521 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe345dc-d651-423a-995f-289a9e21d695" containerName="kube-rbac-proxy" Jul 27 09:29:04.762275 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.762255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764496 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764506 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hp8br\"" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764548 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764540 2566 scope.go:117] "RemoveContainer" containerID="9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764605 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 09:29:04.764662 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764628 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 09:29:04.764955 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764870 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 09:29:04.765001 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.764962 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 09:29:04.765049 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.765022 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc\": container with ID starting with 9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc not found: ID does not exist" containerID="9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" Jul 27 09:29:04.765112 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765059 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc"} err="failed to get container status \"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc\": rpc error: code = NotFound desc = could not find container \"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc\": container with ID starting with 9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc not found: ID does not exist" Jul 27 09:29:04.765178 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765112 2566 scope.go:117] "RemoveContainer" containerID="7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" Jul 27 09:29:04.765402 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.765381 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d\": container with ID starting with 7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d not found: ID does not exist" containerID="7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" Jul 27 09:29:04.765508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765407 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d"} err="failed to get container status \"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d\": rpc error: code = NotFound desc = could not find container \"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d\": container with ID starting with 7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d not found: ID does not exist" Jul 27 09:29:04.765508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765428 2566 scope.go:117] "RemoveContainer" containerID="7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" Jul 27 09:29:04.765508 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765431 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 09:29:04.765693 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.765677 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042\": container with ID starting with 7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042 not found: ID does not exist" containerID="7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" Jul 27 09:29:04.765734 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765699 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042"} err="failed to get container status \"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042\": rpc error: code = NotFound desc = could not find container \"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042\": container with ID starting with 7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042 not found: ID does not exist" Jul 27 09:29:04.765734 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765713 2566 scope.go:117] "RemoveContainer" containerID="227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" Jul 27 09:29:04.765976 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.765953 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c\": container with ID starting with 227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c not found: ID does not exist" containerID="227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" Jul 27 09:29:04.766050 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765984 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c"} err="failed to get container status \"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c\": rpc error: code = NotFound desc = could not find container \"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c\": container with ID starting with 227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c not found: ID does not exist" Jul 27 09:29:04.766050 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.765999 2566 scope.go:117] "RemoveContainer" containerID="5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" Jul 27 09:29:04.766267 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.766250 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7\": container with ID starting with 5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7 not found: ID does not exist" containerID="5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" Jul 27 09:29:04.766314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766272 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7"} err="failed to get container status \"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7\": rpc error: code = NotFound desc = could not find container \"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7\": container with ID starting with 5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7 not found: ID does not exist" Jul 27 09:29:04.766314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766287 2566 scope.go:117] "RemoveContainer" containerID="c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" Jul 27 09:29:04.766515 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.766492 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e\": container with ID starting with c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e not found: ID does not exist" containerID="c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" Jul 27 09:29:04.766583 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766522 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e"} err="failed to get container status \"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e\": rpc error: code = NotFound desc = could not find container \"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e\": container with ID starting with c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e not found: ID does not exist" Jul 27 09:29:04.766583 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766542 2566 scope.go:117] "RemoveContainer" containerID="2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172" Jul 27 09:29:04.766805 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:04.766786 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172\": container with ID starting with 2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172 not found: ID does not exist" containerID="2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172" Jul 27 09:29:04.766877 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766808 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172"} err="failed to get container status \"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172\": rpc error: code = NotFound desc = could not find container \"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172\": container with ID starting with 2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172 not found: ID does not exist" Jul 27 09:29:04.766877 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.766821 2566 scope.go:117] "RemoveContainer" containerID="9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc" Jul 27 09:29:04.767099 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767081 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc"} err="failed to get container status \"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc\": rpc error: code = NotFound desc = could not find container \"9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc\": container with ID starting with 9e1c7f07505934e6b8370e9a1b8b0942c3f9b12344407f349c20bf29aa8fe4dc not found: ID does not exist" Jul 27 09:29:04.767156 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767099 2566 scope.go:117] "RemoveContainer" containerID="7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d" Jul 27 09:29:04.767381 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767358 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d"} err="failed to get container status \"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d\": rpc error: code = NotFound desc = could not find container \"7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d\": container with ID starting with 7d82f8c13ce6f9f39adb7f80b2df402d823522649e50a82dff421c576526010d not found: ID does not exist" Jul 27 09:29:04.767381 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767381 2566 scope.go:117] "RemoveContainer" containerID="7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042" Jul 27 09:29:04.767623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767605 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042"} err="failed to get container status \"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042\": rpc error: code = NotFound desc = could not find container \"7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042\": container with ID starting with 7e2cb06454dd9640671e4c21a9fd72e9f9f8e861375d07f47b563b1c4c1eb042 not found: ID does not exist" Jul 27 09:29:04.767623 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767623 2566 scope.go:117] "RemoveContainer" containerID="227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c" Jul 27 09:29:04.767836 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767817 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c"} err="failed to get container status \"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c\": rpc error: code = NotFound desc = could not find container \"227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c\": container with ID starting with 227ac1cf2f3ada4d1a2cc8173b01e4f6548f61e4fe83714d1283354c4e0f971c not found: ID does not exist" Jul 27 09:29:04.767903 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.767837 2566 scope.go:117] "RemoveContainer" containerID="5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7" Jul 27 09:29:04.768123 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.768088 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7"} err="failed to get container status \"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7\": rpc error: code = NotFound desc = could not find container \"5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7\": container with ID starting with 5753be4d24068df07f62d7899d9f2f4d89f6ef7194faf1f2683761bbbfc6edf7 not found: ID does not exist" Jul 27 09:29:04.768123 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.768114 2566 scope.go:117] "RemoveContainer" containerID="c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e" Jul 27 09:29:04.768357 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.768340 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e"} err="failed to get container status \"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e\": rpc error: code = NotFound desc = could not find container \"c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e\": container with ID starting with c6d7eae983015aa71b38c9c75c300b5eea14d2ab7058450c731bab89fe1d2c6e not found: ID does not exist" Jul 27 09:29:04.768412 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.768359 2566 scope.go:117] "RemoveContainer" containerID="2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172" Jul 27 09:29:04.768557 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.768536 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172"} err="failed to get container status \"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172\": rpc error: code = NotFound desc = could not find container \"2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172\": container with ID starting with 2e2064d99c570edb7f4577234e4b01c5d4bed594d26fd92173fcf03e42a15172 not found: ID does not exist" Jul 27 09:29:04.770802 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.770780 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 09:29:04.774480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.774457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:04.787302 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-out\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787411 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787411 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqvzd\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-kube-api-access-xqvzd\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787411 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-web-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787411 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787530 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787457 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787530 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787530 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787615 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787615 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787676 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787676 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.787676 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.787643 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888073 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-out\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888073 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888073 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqvzd\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-kube-api-access-xqvzd\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-web-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888403 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.888805 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.888681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.889488 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.889460 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.889731 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.889677 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec676e4-200b-4c5a-b879-2d9e40542d6e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.890969 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.890947 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-out\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.891340 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.891307 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-web-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.891639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.891615 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.891734 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.891665 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.891791 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.891752 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.892083 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.892055 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.892184 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.892101 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.892298 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.892279 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ec676e4-200b-4c5a-b879-2d9e40542d6e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.893070 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.893056 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:04.896105 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:04.896088 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqvzd\" (UniqueName: \"kubernetes.io/projected/5ec676e4-200b-4c5a-b879-2d9e40542d6e-kube-api-access-xqvzd\") pod \"alertmanager-main-0\" (UID: \"5ec676e4-200b-4c5a-b879-2d9e40542d6e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:05.073181 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.073091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 09:29:05.220634 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.220603 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 09:29:05.222819 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:29:05.222793 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec676e4_200b_4c5a_b879_2d9e40542d6e.slice/crio-e8b4b960ed0fe9122f7265a81384d556030c46516933a1f5c232d75421b1aac1 WatchSource:0}: Error finding container e8b4b960ed0fe9122f7265a81384d556030c46516933a1f5c232d75421b1aac1: Status 404 returned error can't find the container with id e8b4b960ed0fe9122f7265a81384d556030c46516933a1f5c232d75421b1aac1 Jul 27 09:29:05.617489 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.617455 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe345dc-d651-423a-995f-289a9e21d695" path="/var/lib/kubelet/pods/dbe345dc-d651-423a-995f-289a9e21d695/volumes" Jul 27 09:29:05.705267 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.705215 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ec676e4-200b-4c5a-b879-2d9e40542d6e" containerID="f5beb338df07e5a5775309e71c3f00bdd017390455ff9c6aa95916a87a5f4c28" exitCode=0 Jul 27 09:29:05.705661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.705280 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerDied","Data":"f5beb338df07e5a5775309e71c3f00bdd017390455ff9c6aa95916a87a5f4c28"} Jul 27 09:29:05.705661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:05.705344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"e8b4b960ed0fe9122f7265a81384d556030c46516933a1f5c232d75421b1aac1"} Jul 27 09:29:06.713876 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.713840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"c244c999ad7a026076f3162c0912de04377a68ada4c80da7be5b8ae3c5b0afab"} Jul 27 09:29:06.714293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.713906 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"61db4cc02294975ddae1141a490fe374ffdc3122d6b4b2e6f83d87b79567e40e"} Jul 27 09:29:06.714293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.713937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"7ec3abebcfd385bb37c0dfda05f102994fec9894cb535ae355a67054e5762fe7"} Jul 27 09:29:06.714293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.713962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"999edfc658b901ace3ce70b8b4a2820f6255e7fdf62b536a28fcf645a029a1a4"} Jul 27 09:29:06.714293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.713986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"a98e74744ebb36ded69274f834119236e7ceb92b2da2f30dcec465100c37bdb8"} Jul 27 09:29:06.714293 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.714008 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ec676e4-200b-4c5a-b879-2d9e40542d6e","Type":"ContainerStarted","Data":"750923df949d9012100e7f0f1d64f0c136551bc43a411c59acd01e2f61671d07"} Jul 27 09:29:06.765878 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:06.765805 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.750445674 podStartE2EDuration="2.765782769s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.337095ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:29:06.76533399 +0000 UTC m=+267.674508602" watchObservedRunningTime="2026-07-27 09:29:06.765782769 +0000 UTC m=+267.674957346" Jul 27 09:29:07.034554 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034469 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:07.034818 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034785 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="prometheus" containerID="cri-o://836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51" gracePeriod=600 Jul 27 09:29:07.034818 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034805 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="thanos-sidecar" containerID="cri-o://a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba" gracePeriod=600 Jul 27 09:29:07.034978 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034828 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492" gracePeriod=600 Jul 27 09:29:07.034978 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034842 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-web" containerID="cri-o://6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22" gracePeriod=600 Jul 27 09:29:07.034978 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034809 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="config-reloader" containerID="cri-o://0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301" gracePeriod=600 Jul 27 09:29:07.034978 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.034795 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy" containerID="cri-o://3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572" gracePeriod=600 Jul 27 09:29:07.722650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722616 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492" exitCode=0 Jul 27 09:29:07.722650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722641 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572" exitCode=0 Jul 27 09:29:07.722650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722648 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba" exitCode=0 Jul 27 09:29:07.722650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722654 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301" exitCode=0 Jul 27 09:29:07.722650 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722659 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51" exitCode=0 Jul 27 09:29:07.723466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492"} Jul 27 09:29:07.723466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722748 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572"} Jul 27 09:29:07.723466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba"} Jul 27 09:29:07.723466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301"} Jul 27 09:29:07.723466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:07.722820 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51"} Jul 27 09:29:08.289770 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.289735 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.318204 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318174 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318394 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318219 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318394 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318273 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318394 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318298 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318394 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318338 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318394 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318372 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318398 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318437 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318464 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318489 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318530 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318561 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318586 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.318642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318620 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318648 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318676 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318701 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pdcv\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318732 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318752 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318796 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.318818 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\" (UID: \"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7\") " Jul 27 09:29:08.319368 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.319068 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.319368 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.319095 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.319368 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.319164 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.320115 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.319726 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.320585 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.320561 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:29:08.320753 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.320706 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.321316 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.321268 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.321713 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.321679 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:29:08.322073 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.322028 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.322727 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.322282 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:29:08.322727 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.322348 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.322727 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.322417 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.322940 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.322791 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out" (OuterVolumeSpecName: "config-out") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:29:08.323674 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.323630 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.323779 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.323737 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.323779 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.323755 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.324172 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.324145 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv" (OuterVolumeSpecName: "kube-api-access-7pdcv") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "kube-api-access-7pdcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:29:08.325117 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.325092 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.325218 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.325153 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config" (OuterVolumeSpecName: "config") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.335980 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.335941 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config" (OuterVolumeSpecName: "web-config") pod "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" (UID: "abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419819 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-kube-rbac-proxy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419856 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419867 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419877 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-tls-assets\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419886 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419896 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419906 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-metrics-client-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419914 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-grpc-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.419919 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419923 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-web-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419930 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-db\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419938 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-metrics-client-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419946 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419954 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419962 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419969 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config-out\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419977 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419985 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.419992 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.420314 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.420001 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pdcv\" (UniqueName: \"kubernetes.io/projected/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7-kube-api-access-7pdcv\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:29:08.729842 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.729760 2566 generic.go:356] "Generic (PLEG): container finished" podID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerID="6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22" exitCode=0 Jul 27 09:29:08.729842 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.729834 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.730339 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.729849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22"} Jul 27 09:29:08.730339 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.729937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7","Type":"ContainerDied","Data":"3844ad9edf41626301b40d435d540d6450ec2239483fa426e53674b083e88328"} Jul 27 09:29:08.730339 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.729989 2566 scope.go:117] "RemoveContainer" containerID="08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492" Jul 27 09:29:08.738165 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.738148 2566 scope.go:117] "RemoveContainer" containerID="3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572" Jul 27 09:29:08.745781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.745763 2566 scope.go:117] "RemoveContainer" containerID="6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22" Jul 27 09:29:08.753322 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.753297 2566 scope.go:117] "RemoveContainer" containerID="a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba" Jul 27 09:29:08.753528 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.753508 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:08.757195 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.757054 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:08.764560 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.764541 2566 scope.go:117] "RemoveContainer" containerID="0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301" Jul 27 09:29:08.771564 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.771544 2566 scope.go:117] "RemoveContainer" containerID="836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51" Jul 27 09:29:08.779073 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.779052 2566 scope.go:117] "RemoveContainer" containerID="3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4" Jul 27 09:29:08.782559 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782537 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:08.782872 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782857 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="config-reloader" Jul 27 09:29:08.782872 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782872 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="config-reloader" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782882 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782888 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782903 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="thanos-sidecar" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782910 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="thanos-sidecar" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782925 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-thanos" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782931 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-thanos" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782938 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-web" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782943 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-web" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782953 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="init-config-reloader" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782958 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="init-config-reloader" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782970 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="prometheus" Jul 27 09:29:08.783013 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.782977 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="prometheus" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783035 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="prometheus" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783043 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="thanos-sidecar" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783053 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783061 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-thanos" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783066 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="config-reloader" Jul 27 09:29:08.783543 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.783073 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" containerName="kube-rbac-proxy-web" Jul 27 09:29:08.788752 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.788734 2566 scope.go:117] "RemoveContainer" containerID="08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492" Jul 27 09:29:08.789085 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.789060 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492\": container with ID starting with 08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492 not found: ID does not exist" containerID="08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492" Jul 27 09:29:08.789177 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789095 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492"} err="failed to get container status \"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492\": rpc error: code = NotFound desc = could not find container \"08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492\": container with ID starting with 08ee66a3e0098fcce9427a63541b377a691cae1102b745c1981943d35126c492 not found: ID does not exist" Jul 27 09:29:08.789177 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789113 2566 scope.go:117] "RemoveContainer" containerID="3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572" Jul 27 09:29:08.789385 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.789368 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572\": container with ID starting with 3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572 not found: ID does not exist" containerID="3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572" Jul 27 09:29:08.789420 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789392 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572"} err="failed to get container status \"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572\": rpc error: code = NotFound desc = could not find container \"3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572\": container with ID starting with 3ced371639f4b4a734ba5c6513368644bdb01ccd3b0bc4cb347d57a16913e572 not found: ID does not exist" Jul 27 09:29:08.789420 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789407 2566 scope.go:117] "RemoveContainer" containerID="6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22" Jul 27 09:29:08.789644 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.789626 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22\": container with ID starting with 6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22 not found: ID does not exist" containerID="6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22" Jul 27 09:29:08.789695 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789651 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22"} err="failed to get container status \"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22\": rpc error: code = NotFound desc = could not find container \"6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22\": container with ID starting with 6bf606bc65d7c9b0a0c2b95f2e560633d6af1d59bce5ff92ba144a73025abd22 not found: ID does not exist" Jul 27 09:29:08.789695 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789671 2566 scope.go:117] "RemoveContainer" containerID="a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba" Jul 27 09:29:08.789899 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.789881 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba\": container with ID starting with a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba not found: ID does not exist" containerID="a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba" Jul 27 09:29:08.789970 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789907 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba"} err="failed to get container status \"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba\": rpc error: code = NotFound desc = could not find container \"a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba\": container with ID starting with a3d903fa574f749873523790f52830820b3bc05efd2e1563b3f49880393ea4ba not found: ID does not exist" Jul 27 09:29:08.789970 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.789927 2566 scope.go:117] "RemoveContainer" containerID="0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301" Jul 27 09:29:08.790179 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.790163 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301\": container with ID starting with 0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301 not found: ID does not exist" containerID="0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301" Jul 27 09:29:08.790315 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790185 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301"} err="failed to get container status \"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301\": rpc error: code = NotFound desc = could not find container \"0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301\": container with ID starting with 0e6c9a0523e3af5c015aa5e6068a54e9396b03b33f4998d286bdc454d6c78301 not found: ID does not exist" Jul 27 09:29:08.790315 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790202 2566 scope.go:117] "RemoveContainer" containerID="836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51" Jul 27 09:29:08.790473 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.790454 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51\": container with ID starting with 836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51 not found: ID does not exist" containerID="836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51" Jul 27 09:29:08.790525 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790480 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51"} err="failed to get container status \"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51\": rpc error: code = NotFound desc = could not find container \"836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51\": container with ID starting with 836a3153d039b3c5f04879ecf45f4279a6e9c48006e2161ad27d774fd2a4aa51 not found: ID does not exist" Jul 27 09:29:08.790525 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790494 2566 scope.go:117] "RemoveContainer" containerID="3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4" Jul 27 09:29:08.790681 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790664 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.790714 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:29:08.790703 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4\": container with ID starting with 3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4 not found: ID does not exist" containerID="3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4" Jul 27 09:29:08.790747 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.790719 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4"} err="failed to get container status \"3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4\": rpc error: code = NotFound desc = could not find container \"3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4\": container with ID starting with 3dcea3cd9d2db5eaf21be9e49b1dbe6aa23b291bad8357a7534bf78a657926f4 not found: ID does not exist" Jul 27 09:29:08.793247 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793216 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 09:29:08.793247 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793222 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 09:29:08.793421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 09:29:08.793421 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793357 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 09:29:08.793531 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793516 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-av2shm5rn558u\"" Jul 27 09:29:08.793600 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 09:29:08.793886 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793866 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 09:29:08.793982 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.793923 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 09:29:08.794159 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794143 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 09:29:08.794309 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794145 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 09:29:08.794355 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 09:29:08.794440 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794425 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gpcjw\"" Jul 27 09:29:08.794992 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794973 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 09:29:08.795080 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.794994 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 09:29:08.795387 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.795368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 09:29:08.798466 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.798260 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 09:29:08.803241 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.803198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 09:29:08.808836 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.808814 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:08.823133 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-web-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbqg\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-kube-api-access-2jbqg\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823506 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823506 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823506 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823506 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823506 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-config-out\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823642 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823778 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823778 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.823778 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.823694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.924749 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.924749 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924777 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-config-out\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925012 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.924995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925265 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-web-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbqg\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-kube-api-access-2jbqg\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925359 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.925594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.925580 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.926187 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.926162 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.927898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.927966 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36273044-cfce-4dd9-943d-99cca425758e-config-out\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928036 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928308 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928046 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928663 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928633 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928924 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928807 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928924 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928835 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.928924 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.928842 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-web-config\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.929362 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.929337 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.929449 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.929367 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.929449 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.929378 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.930460 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.930434 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.930983 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.930967 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.931441 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.931418 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36273044-cfce-4dd9-943d-99cca425758e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.931669 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.931653 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36273044-cfce-4dd9-943d-99cca425758e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:08.936282 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:08.936262 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbqg\" (UniqueName: \"kubernetes.io/projected/36273044-cfce-4dd9-943d-99cca425758e-kube-api-access-2jbqg\") pod \"prometheus-k8s-0\" (UID: \"36273044-cfce-4dd9-943d-99cca425758e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:09.103081 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.102980 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:09.247541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.247518 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 09:29:09.249185 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:29:09.249156 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36273044_cfce_4dd9_943d_99cca425758e.slice/crio-277e71950594e02bb84dce1ef8a5568487a73dd0b915a94f3eaf35facce6fd70 WatchSource:0}: Error finding container 277e71950594e02bb84dce1ef8a5568487a73dd0b915a94f3eaf35facce6fd70: Status 404 returned error can't find the container with id 277e71950594e02bb84dce1ef8a5568487a73dd0b915a94f3eaf35facce6fd70 Jul 27 09:29:09.616346 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.616315 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7" path="/var/lib/kubelet/pods/abe29e42-5ee2-4e84-bc23-9c4b7d9e7db7/volumes" Jul 27 09:29:09.736319 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.736286 2566 generic.go:356] "Generic (PLEG): container finished" podID="36273044-cfce-4dd9-943d-99cca425758e" containerID="cebc2fc8dcf0c457525cc555ba45fe2a70329655be0d9a162acc02bfa3db16c6" exitCode=0 Jul 27 09:29:09.736724 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.736365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerDied","Data":"cebc2fc8dcf0c457525cc555ba45fe2a70329655be0d9a162acc02bfa3db16c6"} Jul 27 09:29:09.736724 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:09.736453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"277e71950594e02bb84dce1ef8a5568487a73dd0b915a94f3eaf35facce6fd70"} Jul 27 09:29:10.750010 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.749971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"12ae22c80f6a20fb4c56a66791037b66170fe748850adef9630266f93d22b6a2"} Jul 27 09:29:10.750477 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.750059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"2fe63fe9d9bca19e56e7b681d4bb83f67dff30a4e0fa6062582a03a49cb65fc9"} Jul 27 09:29:10.750477 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.750089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"34c1d5d0d2dc39413b75c7c5112490a9be1c8bf7d0515282aa3d1236ab066173"} Jul 27 09:29:10.750477 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.750113 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"578621d550bb67602c3b1173da8d8b0b794aaceb5cedbcf8ced795f0102d08fd"} Jul 27 09:29:10.750477 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.750136 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"41f2d57973a2c0a2d9372c5845e5f6061a755f9c93c381b9ad2cd657b77f0fb9"} Jul 27 09:29:10.750477 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.750158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36273044-cfce-4dd9-943d-99cca425758e","Type":"ContainerStarted","Data":"03c6a1156094c6eab726235e52c8a32cba6ebf7f1a22eb971f349700a0741990"} Jul 27 09:29:10.780222 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:10.780168 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.760556221 podStartE2EDuration="2.780150225s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.594004ms" isStatefulPod=false podCreationTimestamp="2026-07-27 09:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:29:10.779006128 +0000 UTC m=+271.688180724" watchObservedRunningTime="2026-07-27 09:29:10.780150225 +0000 UTC m=+271.689324855" Jul 27 09:29:14.103798 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:14.103743 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:29:39.530806 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:29:39.530783 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 09:30:09.103370 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:30:09.103336 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:30:09.118613 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:30:09.118581 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:30:09.998010 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:30:09.997985 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 09:34:29.963080 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.963040 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:34:29.966151 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.966134 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:29.969139 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.969111 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 09:34:29.969139 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.969112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 09:34:29.969360 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.969116 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 09:34:29.969360 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.969121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-fg8n9\"" Jul 27 09:34:29.969360 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.969138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 09:34:29.977375 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:29.977352 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:34:30.140900 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.140861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.141060 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.140909 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9w6\" (UniqueName: \"kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.141060 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.141007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.242419 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.242322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.242588 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.242427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.242588 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.242460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9w6\" (UniqueName: \"kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.242975 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.242944 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.244686 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.244666 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.250352 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.250330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9w6\" (UniqueName: \"kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.292868 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.292836 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:30.428299 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.428276 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:34:30.430377 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:34:30.430352 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ddb21fb_13cf_42f6_88c8_983edc0b8c89.slice/crio-24b6fcce93d8efc131d4ee07ae07749b62414c8757f6e9153d6481c148efedec WatchSource:0}: Error finding container 24b6fcce93d8efc131d4ee07ae07749b62414c8757f6e9153d6481c148efedec: Status 404 returned error can't find the container with id 24b6fcce93d8efc131d4ee07ae07749b62414c8757f6e9153d6481c148efedec Jul 27 09:34:30.432320 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:30.432302 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 09:34:31.026112 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:31.026073 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" event={"ID":"3ddb21fb-13cf-42f6-88c8-983edc0b8c89","Type":"ContainerStarted","Data":"24b6fcce93d8efc131d4ee07ae07749b62414c8757f6e9153d6481c148efedec"} Jul 27 09:34:33.036498 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:33.036467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" event={"ID":"3ddb21fb-13cf-42f6-88c8-983edc0b8c89","Type":"ContainerStarted","Data":"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a"} Jul 27 09:34:33.037059 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:33.036597 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:33.053376 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:33.053325 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" podStartSLOduration=1.542868753 podStartE2EDuration="4.053308351s" totalImagesPullingTime="2.510439598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:34:33.052017212 +0000 UTC m=+593.961191801" watchObservedRunningTime="2026-07-27 09:34:33.053308351 +0000 UTC m=+593.962482927" Jul 27 09:34:49.045889 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:49.045853 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:34:51.749049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.749014 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8ppsx"] Jul 27 09:34:51.755309 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.755291 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:34:51.757377 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.757356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txksq\"" Jul 27 09:34:51.760514 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.760490 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8ppsx"] Jul 27 09:34:51.808144 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.808107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mlq7\" (UniqueName: \"kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7\") pod \"test-trainjob-workflow-node-0-0-8ppsx\" (UID: \"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:34:51.909227 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.909176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlq7\" (UniqueName: \"kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7\") pod \"test-trainjob-workflow-node-0-0-8ppsx\" (UID: \"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:34:51.918826 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:51.918792 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mlq7\" (UniqueName: \"kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7\") pod \"test-trainjob-workflow-node-0-0-8ppsx\" (UID: \"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:34:52.065263 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:52.065161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:34:52.197296 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:52.197266 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8ppsx"] Jul 27 09:34:52.200950 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:34:52.200914 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec0c5675_0b9f_4243_9e4d_1ec92eb3222d.slice/crio-6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07 WatchSource:0}: Error finding container 6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07: Status 404 returned error can't find the container with id 6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07 Jul 27 09:34:53.131406 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:34:53.131360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" event={"ID":"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d","Type":"ContainerStarted","Data":"6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07"} Jul 27 09:35:55.449844 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:55.449807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" event={"ID":"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d","Type":"ContainerStarted","Data":"300d1b24fdd414aa93ec988c3bc5f8eabf7467a9c5b4eda1ddcbfc81e4c145f8"} Jul 27 09:35:55.468339 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:55.468294 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" podStartSLOduration=1.799330197 podStartE2EDuration="1m4.468278888s" totalImagesPullingTime="1m2.668948691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:35:55.46632841 +0000 UTC m=+676.375502986" watchObservedRunningTime="2026-07-27 09:35:55.468278888 +0000 UTC m=+676.377453466" Jul 27 09:35:58.464658 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:58.464619 2566 generic.go:356] "Generic (PLEG): container finished" podID="ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" containerID="300d1b24fdd414aa93ec988c3bc5f8eabf7467a9c5b4eda1ddcbfc81e4c145f8" exitCode=0 Jul 27 09:35:58.465143 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:58.464699 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" event={"ID":"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d","Type":"ContainerDied","Data":"300d1b24fdd414aa93ec988c3bc5f8eabf7467a9c5b4eda1ddcbfc81e4c145f8"} Jul 27 09:35:59.638271 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:59.638218 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:35:59.761270 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:59.761161 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mlq7\" (UniqueName: \"kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7\") pod \"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d\" (UID: \"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d\") " Jul 27 09:35:59.763345 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:59.763318 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7" (OuterVolumeSpecName: "kube-api-access-9mlq7") pod "ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" (UID: "ec0c5675-0b9f-4243-9e4d-1ec92eb3222d"). InnerVolumeSpecName "kube-api-access-9mlq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:35:59.861898 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:35:59.861861 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mlq7\" (UniqueName: \"kubernetes.io/projected/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d-kube-api-access-9mlq7\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:36:00.474225 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:00.474190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" event={"ID":"ec0c5675-0b9f-4243-9e4d-1ec92eb3222d","Type":"ContainerDied","Data":"6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07"} Jul 27 09:36:00.474225 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:00.474222 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8ppsx" Jul 27 09:36:00.474513 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:00.474228 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6716933dd7299ff205b348b478c3d8898855bcbf61516d71e01b8044abc3ed07" Jul 27 09:36:00.988690 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:00.988646 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8ppsx"] Jul 27 09:36:00.993449 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:00.993422 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8ppsx"] Jul 27 09:36:01.135420 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.135379 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:36:01.479533 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.479487 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" podUID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" containerName="manager" containerID="cri-o://2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a" gracePeriod=30 Jul 27 09:36:01.617057 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.617029 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" path="/var/lib/kubelet/pods/ec0c5675-0b9f-4243-9e4d-1ec92eb3222d/volumes" Jul 27 09:36:01.759273 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.759202 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:36:01.879568 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.879534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config\") pod \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " Jul 27 09:36:01.879773 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.879587 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m9w6\" (UniqueName: \"kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6\") pod \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " Jul 27 09:36:01.879773 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.879617 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert\") pod \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\" (UID: \"3ddb21fb-13cf-42f6-88c8-983edc0b8c89\") " Jul 27 09:36:01.881637 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.881600 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6" (OuterVolumeSpecName: "kube-api-access-6m9w6") pod "3ddb21fb-13cf-42f6-88c8-983edc0b8c89" (UID: "3ddb21fb-13cf-42f6-88c8-983edc0b8c89"). InnerVolumeSpecName "kube-api-access-6m9w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:36:01.881744 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.881705 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert" (OuterVolumeSpecName: "cert") pod "3ddb21fb-13cf-42f6-88c8-983edc0b8c89" (UID: "3ddb21fb-13cf-42f6-88c8-983edc0b8c89"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 09:36:01.884191 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.884166 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "3ddb21fb-13cf-42f6-88c8-983edc0b8c89" (UID: "3ddb21fb-13cf-42f6-88c8-983edc0b8c89"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 09:36:01.980661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.980629 2566 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:36:01.980661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.980655 2566 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kubeflow-trainer-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:36:01.980661 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:01.980665 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m9w6\" (UniqueName: \"kubernetes.io/projected/3ddb21fb-13cf-42f6-88c8-983edc0b8c89-kube-api-access-6m9w6\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:36:02.485018 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.484981 2566 generic.go:356] "Generic (PLEG): container finished" podID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" containerID="2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a" exitCode=0 Jul 27 09:36:02.485018 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.485022 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" Jul 27 09:36:02.485461 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.485043 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" event={"ID":"3ddb21fb-13cf-42f6-88c8-983edc0b8c89","Type":"ContainerDied","Data":"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a"} Jul 27 09:36:02.485461 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.485079 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6" event={"ID":"3ddb21fb-13cf-42f6-88c8-983edc0b8c89","Type":"ContainerDied","Data":"24b6fcce93d8efc131d4ee07ae07749b62414c8757f6e9153d6481c148efedec"} Jul 27 09:36:02.485461 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.485101 2566 scope.go:117] "RemoveContainer" containerID="2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a" Jul 27 09:36:02.493360 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.493341 2566 scope.go:117] "RemoveContainer" containerID="2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a" Jul 27 09:36:02.493641 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:36:02.493622 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a\": container with ID starting with 2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a not found: ID does not exist" containerID="2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a" Jul 27 09:36:02.493689 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.493650 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a"} err="failed to get container status \"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a\": rpc error: code = NotFound desc = could not find container \"2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a\": container with ID starting with 2568339f13d9c6ae96fc307b4d9b971125275d3ea279bee590c028cbc444ac0a not found: ID does not exist" Jul 27 09:36:02.504904 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.504884 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:36:02.508464 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:02.508445 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-s7qf6"] Jul 27 09:36:03.616382 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:03.616346 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" path="/var/lib/kubelet/pods/3ddb21fb-13cf-42f6-88c8-983edc0b8c89/volumes" Jul 27 09:36:04.252956 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.252920 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wr9t5/must-gather-bkcsf"] Jul 27 09:36:04.253269 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253256 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" containerName="manager" Jul 27 09:36:04.253325 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253270 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" containerName="manager" Jul 27 09:36:04.253325 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253291 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" containerName="node" Jul 27 09:36:04.253325 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253297 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" containerName="node" Jul 27 09:36:04.253433 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253350 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ddb21fb-13cf-42f6-88c8-983edc0b8c89" containerName="manager" Jul 27 09:36:04.253433 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.253358 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0c5675-0b9f-4243-9e4d-1ec92eb3222d" containerName="node" Jul 27 09:36:04.267064 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.267038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wr9t5/must-gather-bkcsf"] Jul 27 09:36:04.267173 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.267125 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.269546 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.269522 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wr9t5\"/\"kube-root-ca.crt\"" Jul 27 09:36:04.269546 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.269540 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wr9t5\"/\"default-dockercfg-jntv5\"" Jul 27 09:36:04.270198 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.270177 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wr9t5\"/\"openshift-service-ca.crt\"" Jul 27 09:36:04.402657 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.402623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8g6l\" (UniqueName: \"kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.402818 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.402676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.503615 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.503537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8g6l\" (UniqueName: \"kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.503615 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.503587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.503913 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.503896 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.512653 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.512630 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8g6l\" (UniqueName: \"kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l\") pod \"must-gather-bkcsf\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.588222 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.588188 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:36:04.735338 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:04.735210 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wr9t5/must-gather-bkcsf"] Jul 27 09:36:04.737975 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:36:04.737950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26b4c9a1_72e5_47c7_ab30_9db31c7f509a.slice/crio-8245e15349de2ff7ce66cb502ba9565dd28b2e76d2feb13959d2f325ec1e7064 WatchSource:0}: Error finding container 8245e15349de2ff7ce66cb502ba9565dd28b2e76d2feb13959d2f325ec1e7064: Status 404 returned error can't find the container with id 8245e15349de2ff7ce66cb502ba9565dd28b2e76d2feb13959d2f325ec1e7064 Jul 27 09:36:05.500947 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:05.500913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" event={"ID":"26b4c9a1-72e5-47c7-ab30-9db31c7f509a","Type":"ContainerStarted","Data":"8245e15349de2ff7ce66cb502ba9565dd28b2e76d2feb13959d2f325ec1e7064"} Jul 27 09:36:12.538077 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:12.537969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" event={"ID":"26b4c9a1-72e5-47c7-ab30-9db31c7f509a","Type":"ContainerStarted","Data":"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e"} Jul 27 09:36:13.544558 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:13.544515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" event={"ID":"26b4c9a1-72e5-47c7-ab30-9db31c7f509a","Type":"ContainerStarted","Data":"ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa"} Jul 27 09:36:13.562773 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:13.562718 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" podStartSLOduration=2.037469143 podStartE2EDuration="9.56270291s" totalImagesPullingTime="7.525233767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 09:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:36:13.561546415 +0000 UTC m=+694.470720995" watchObservedRunningTime="2026-07-27 09:36:13.56270291 +0000 UTC m=+694.471877487" Jul 27 09:36:58.759931 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:58.759894 2566 generic.go:356] "Generic (PLEG): container finished" podID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerID="fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e" exitCode=0 Jul 27 09:36:58.760349 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:58.759964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" event={"ID":"26b4c9a1-72e5-47c7-ab30-9db31c7f509a","Type":"ContainerDied","Data":"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e"} Jul 27 09:36:58.760349 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:58.760292 2566 scope.go:117] "RemoveContainer" containerID="fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e" Jul 27 09:36:59.310437 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:36:59.310412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wr9t5_must-gather-bkcsf_26b4c9a1-72e5-47c7-ab30-9db31c7f509a/gather/0.log" Jul 27 09:37:02.389156 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:02.389127 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h5ssc_8709629b-6db6-42db-97d8-71b38defc42d/global-pull-secret-syncer/0.log" Jul 27 09:37:02.516784 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:02.516756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r5pmr_ee81109f-b933-49b5-8b94-784363f7986f/konnectivity-agent/0.log" Jul 27 09:37:02.597717 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:02.597686 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-82.ec2.internal_2631d8e8e693fdb9ec27ceacdf6c4954/haproxy/0.log" Jul 27 09:37:04.703639 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:04.703601 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wr9t5/must-gather-bkcsf"] Jul 27 09:37:04.704077 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:04.703822 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="copy" containerID="cri-o://ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa" gracePeriod=2 Jul 27 09:37:04.708590 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:04.707923 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wr9t5/must-gather-bkcsf"] Jul 27 09:37:04.935772 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:04.935753 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wr9t5_must-gather-bkcsf_26b4c9a1-72e5-47c7-ab30-9db31c7f509a/copy/0.log" Jul 27 09:37:04.937547 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:04.937531 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:37:04.939386 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:37:04.939360 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bkcsf\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wr9t5\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:37:05.055129 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.055048 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8g6l\" (UniqueName: \"kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l\") pod \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " Jul 27 09:37:05.055129 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.055093 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output\") pod \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\" (UID: \"26b4c9a1-72e5-47c7-ab30-9db31c7f509a\") " Jul 27 09:37:05.056417 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.056392 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "26b4c9a1-72e5-47c7-ab30-9db31c7f509a" (UID: "26b4c9a1-72e5-47c7-ab30-9db31c7f509a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 09:37:05.057130 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.057108 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l" (OuterVolumeSpecName: "kube-api-access-h8g6l") pod "26b4c9a1-72e5-47c7-ab30-9db31c7f509a" (UID: "26b4c9a1-72e5-47c7-ab30-9db31c7f509a"). InnerVolumeSpecName "kube-api-access-h8g6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 09:37:05.155793 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.155761 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-must-gather-output\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:37:05.155793 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.155786 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8g6l\" (UniqueName: \"kubernetes.io/projected/26b4c9a1-72e5-47c7-ab30-9db31c7f509a-kube-api-access-h8g6l\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\"" Jul 27 09:37:05.616559 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.616530 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" path="/var/lib/kubelet/pods/26b4c9a1-72e5-47c7-ab30-9db31c7f509a/volumes" Jul 27 09:37:05.643909 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.643879 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/alertmanager/0.log" Jul 27 09:37:05.678390 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.678368 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/config-reloader/0.log" Jul 27 09:37:05.721618 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.721582 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/kube-rbac-proxy-web/0.log" Jul 27 09:37:05.751120 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.751089 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/kube-rbac-proxy/0.log" Jul 27 09:37:05.782118 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.782094 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/kube-rbac-proxy-metric/0.log" Jul 27 09:37:05.792302 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.792283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wr9t5_must-gather-bkcsf_26b4c9a1-72e5-47c7-ab30-9db31c7f509a/copy/0.log" Jul 27 09:37:05.792610 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.792591 2566 generic.go:356] "Generic (PLEG): container finished" podID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerID="ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa" exitCode=143 Jul 27 09:37:05.792671 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.792636 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wr9t5/must-gather-bkcsf" Jul 27 09:37:05.792671 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.792664 2566 scope.go:117] "RemoveContainer" containerID="ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa" Jul 27 09:37:05.800453 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.800435 2566 scope.go:117] "RemoveContainer" containerID="fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e" Jul 27 09:37:05.812852 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.812835 2566 scope.go:117] "RemoveContainer" containerID="ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa" Jul 27 09:37:05.813098 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:37:05.813080 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa\": container with ID starting with ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa not found: ID does not exist" containerID="ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa" Jul 27 09:37:05.813142 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.813107 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa"} err="failed to get container status \"ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa\": rpc error: code = NotFound desc = could not find container \"ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa\": container with ID starting with ded47713f4da9130ac363b2eedf009b2170e51160a8d39e5a42acce5f67988aa not found: ID does not exist" Jul 27 09:37:05.813142 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.813129 2566 scope.go:117] "RemoveContainer" containerID="fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e" Jul 27 09:37:05.813378 ip-10-0-128-82 kubenswrapper[2566]: E0727 09:37:05.813358 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e\": container with ID starting with fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e not found: ID does not exist" containerID="fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e" Jul 27 09:37:05.813426 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.813383 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e"} err="failed to get container status \"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e\": rpc error: code = NotFound desc = could not find container \"fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e\": container with ID starting with fd20ae1600aa9776e19e26a27730d06da695a87fd73fba85ae831192c2a8f59e not found: ID does not exist" Jul 27 09:37:05.821665 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.821649 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/prom-label-proxy/0.log" Jul 27 09:37:05.853665 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:05.853643 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ec676e4-200b-4c5a-b879-2d9e40542d6e/init-config-reloader/0.log" Jul 27 09:37:06.071074 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.071000 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-f5zxj_e6d394e5-98b1-4609-98c1-b5c571dd65d9/monitoring-plugin/0.log" Jul 27 09:37:06.109243 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.109205 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8pxp_4f04cbea-cced-4359-b747-fb1127be8df4/node-exporter/0.log" Jul 27 09:37:06.131715 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.131691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8pxp_4f04cbea-cced-4359-b747-fb1127be8df4/kube-rbac-proxy/0.log" Jul 27 09:37:06.156868 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.156846 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d8pxp_4f04cbea-cced-4359-b747-fb1127be8df4/init-textfile/0.log" Jul 27 09:37:06.373938 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.373913 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v6vmf_8e5b4754-97d0-441e-b93b-88ae1d4ecf27/kube-rbac-proxy-main/0.log" Jul 27 09:37:06.402393 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.402373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v6vmf_8e5b4754-97d0-441e-b93b-88ae1d4ecf27/kube-rbac-proxy-self/0.log" Jul 27 09:37:06.428873 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.428849 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v6vmf_8e5b4754-97d0-441e-b93b-88ae1d4ecf27/openshift-state-metrics/0.log" Jul 27 09:37:06.479704 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.479674 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/prometheus/0.log" Jul 27 09:37:06.506879 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.506844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/config-reloader/0.log" Jul 27 09:37:06.532141 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.532110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/thanos-sidecar/0.log" Jul 27 09:37:06.556670 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.556645 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/kube-rbac-proxy-web/0.log" Jul 27 09:37:06.582400 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.582376 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/kube-rbac-proxy/0.log" Jul 27 09:37:06.609712 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.609691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/kube-rbac-proxy-thanos/0.log" Jul 27 09:37:06.636979 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.636920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36273044-cfce-4dd9-943d-99cca425758e/init-config-reloader/0.log" Jul 27 09:37:06.718064 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.718040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-vwrkh_d301ca21-3389-47ef-b3fe-377e6236ce38/prometheus-operator-admission-webhook/0.log" Jul 27 09:37:06.838258 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.838211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/thanos-query/0.log" Jul 27 09:37:06.860696 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.860673 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/kube-rbac-proxy-web/0.log" Jul 27 09:37:06.886781 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.886751 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/kube-rbac-proxy/0.log" Jul 27 09:37:06.910594 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.910534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/prom-label-proxy/0.log" Jul 27 09:37:06.942006 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.941974 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/kube-rbac-proxy-rules/0.log" Jul 27 09:37:06.960541 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:06.960516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-695f997678-njng9_b720ff45-abed-4795-9ba2-1b3e3f1cba34/kube-rbac-proxy-metrics/0.log" Jul 27 09:37:09.776595 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:09.776562 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-cv67l_aac83a7e-a69c-49fb-bc20-c67c40f3f16a/volume-data-source-validator/0.log" Jul 27 09:37:10.346798 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.346763 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd"] Jul 27 09:37:10.347122 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347108 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="gather" Jul 27 09:37:10.347164 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347125 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="gather" Jul 27 09:37:10.347164 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347150 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="copy" Jul 27 09:37:10.347164 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347155 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="copy" Jul 27 09:37:10.347271 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347208 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="copy" Jul 27 09:37:10.347271 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.347222 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b4c9a1-72e5-47c7-ab30-9db31c7f509a" containerName="gather" Jul 27 09:37:10.350759 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.350740 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.353153 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.353133 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l9jqc\"/\"default-dockercfg-nt7h7\"" Jul 27 09:37:10.353153 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.353147 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9jqc\"/\"kube-root-ca.crt\"" Jul 27 09:37:10.353699 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.353684 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9jqc\"/\"openshift-service-ca.crt\"" Jul 27 09:37:10.359033 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.359010 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd"] Jul 27 09:37:10.398675 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.398642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfsqc\" (UniqueName: \"kubernetes.io/projected/4b381076-ddc1-4194-9cfd-e719ee61b3fe-kube-api-access-hfsqc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.398675 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.398680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-proc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.398858 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.398703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-lib-modules\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.398858 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.398772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-sys\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.398858 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.398796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-podres\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.499848 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499815 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-sys\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.499848 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-podres\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfsqc\" (UniqueName: \"kubernetes.io/projected/4b381076-ddc1-4194-9cfd-e719ee61b3fe-kube-api-access-hfsqc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-proc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-lib-modules\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.499956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-sys\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500049 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.500031 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-proc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500201 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.500057 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-lib-modules\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.500201 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.500066 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b381076-ddc1-4194-9cfd-e719ee61b3fe-podres\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.508377 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.508357 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfsqc\" (UniqueName: \"kubernetes.io/projected/4b381076-ddc1-4194-9cfd-e719ee61b3fe-kube-api-access-hfsqc\") pod \"perf-node-gather-daemonset-szqdd\" (UID: \"4b381076-ddc1-4194-9cfd-e719ee61b3fe\") " pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.660847 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.660817 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:10.737254 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.737208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r7r26_738f5986-5028-4703-b421-e09472c0e04f/dns/0.log" Jul 27 09:37:10.760679 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.760652 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r7r26_738f5986-5028-4703-b421-e09472c0e04f/kube-rbac-proxy/0.log" Jul 27 09:37:10.783123 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.783097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cdr9w_a1d1c894-f81e-40c8-a71d-a6608ea79fe9/dns-node-resolver/0.log" Jul 27 09:37:10.788826 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.788779 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd"] Jul 27 09:37:10.790945 ip-10-0-128-82 kubenswrapper[2566]: W0727 09:37:10.790918 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4b381076_ddc1_4194_9cfd_e719ee61b3fe.slice/crio-c63b510e011f53a5e3cc40dcea12df22518315f1b56018fedf544a0bf46c2d52 WatchSource:0}: Error finding container c63b510e011f53a5e3cc40dcea12df22518315f1b56018fedf544a0bf46c2d52: Status 404 returned error can't find the container with id c63b510e011f53a5e3cc40dcea12df22518315f1b56018fedf544a0bf46c2d52 Jul 27 09:37:10.814171 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:10.814144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" event={"ID":"4b381076-ddc1-4194-9cfd-e719ee61b3fe","Type":"ContainerStarted","Data":"c63b510e011f53a5e3cc40dcea12df22518315f1b56018fedf544a0bf46c2d52"} Jul 27 09:37:11.287047 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:11.287018 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk5c4_275c6441-eb8c-43a6-8dcf-08c5e3570c2f/node-ca/0.log" Jul 27 09:37:11.820448 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:11.820414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" event={"ID":"4b381076-ddc1-4194-9cfd-e719ee61b3fe","Type":"ContainerStarted","Data":"7e5a823796a0ec6f7f9c8d9c0156b45c9ed5abd6bf66cd32916b77338d42ed88"} Jul 27 09:37:11.820820 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:11.820475 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:11.837804 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:11.837760 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" podStartSLOduration=1.837744464 podStartE2EDuration="1.837744464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 09:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 09:37:11.836125164 +0000 UTC m=+752.745299756" watchObservedRunningTime="2026-07-27 09:37:11.837744464 +0000 UTC m=+752.746919041" Jul 27 09:37:11.974840 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:11.974802 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bfff56479-vns8n_5dbbf837-e495-4924-b9ab-5df52e6cb9f1/router/0.log" Jul 27 09:37:12.292025 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.291987 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6qjn_4485aa85-ab5f-4e59-9bb3-0adcd783362c/serve-healthcheck-canary/0.log" Jul 27 09:37:12.721675 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.721642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jqscl_3d46ee64-9dd3-4c64-ad72-3b61256378eb/insights-operator/1.log" Jul 27 09:37:12.722212 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.722193 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jqscl_3d46ee64-9dd3-4c64-ad72-3b61256378eb/insights-operator/0.log" Jul 27 09:37:12.742220 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.742197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgwqr_0ec34077-063b-4ee7-9733-240e62fe92cb/kube-rbac-proxy/0.log" Jul 27 09:37:12.764011 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.763987 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgwqr_0ec34077-063b-4ee7-9733-240e62fe92cb/exporter/0.log" Jul 27 09:37:12.787115 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:12.787084 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgwqr_0ec34077-063b-4ee7-9733-240e62fe92cb/extractor/0.log" Jul 27 09:37:17.699699 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:17.699667 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-2vzjg_d444e44e-a3d1-45a2-a657-95c3a54b1080/migrator/0.log" Jul 27 09:37:17.718937 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:17.718915 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-2vzjg_d444e44e-a3d1-45a2-a657-95c3a54b1080/graceful-termination/0.log" Jul 27 09:37:17.834739 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:17.834708 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l9jqc/perf-node-gather-daemonset-szqdd" Jul 27 09:37:18.892562 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:18.892532 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-42mgd_d1f04aff-75ec-4223-909b-1479c6eced75/kube-multus/0.log" Jul 27 09:37:19.332842 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.332762 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/kube-multus-additional-cni-plugins/0.log" Jul 27 09:37:19.357911 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.357881 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/egress-router-binary-copy/0.log" Jul 27 09:37:19.379359 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.379338 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/cni-plugins/0.log" Jul 27 09:37:19.402699 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.402668 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/bond-cni-plugin/0.log" Jul 27 09:37:19.425986 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.425969 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/routeoverride-cni/0.log" Jul 27 09:37:19.450987 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.450964 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/whereabouts-cni-bincopy/0.log" Jul 27 09:37:19.471790 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.471767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdhrz_cbc67ea7-d855-4be5-86ff-e0c3e32950f3/whereabouts-cni/0.log" Jul 27 09:37:19.528348 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.528310 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gr66c_2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08/network-metrics-daemon/0.log" Jul 27 09:37:19.550502 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:19.550461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gr66c_2a2de8bf-85f8-43ec-82ae-e3fd8a99bb08/kube-rbac-proxy/0.log" Jul 27 09:37:20.427757 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.427727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/ovn-controller/0.log" Jul 27 09:37:20.446447 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.446421 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/ovn-acl-logging/0.log" Jul 27 09:37:20.476973 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.476952 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/kube-rbac-proxy-node/0.log" Jul 27 09:37:20.499829 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.499802 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 09:37:20.519499 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.519478 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/northd/0.log" Jul 27 09:37:20.541473 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.541455 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/nbdb/0.log" Jul 27 09:37:20.563170 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.563152 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/sbdb/0.log" Jul 27 09:37:20.616480 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:20.616452 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f76q6_4a585125-e13d-4d16-8ad5-a2a60f3101c6/ovnkube-controller/0.log" Jul 27 09:37:22.010648 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:22.010618 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-q5gm5_9d964010-518d-44ac-9d1a-077f3113ba88/check-endpoints/0.log" Jul 27 09:37:22.076737 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:22.076701 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6l4xq_f26121d2-bc69-4813-bf89-fb8a12a719bf/network-check-target-container/0.log" Jul 27 09:37:23.099108 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:23.099082 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dvsjp_f846b4ef-3a21-4098-a6b4-1ac7b433dbb6/iptables-alerter/0.log" Jul 27 09:37:23.915902 ip-10-0-128-82 kubenswrapper[2566]: I0727 09:37:23.915873 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ckwkt_8b08e22c-d44f-4323-9595-41499b7827c4/tuned/0.log"